-- Logs begin at Tue 2021-10-12 03:27:58 UTC, end at Tue 2021-10-12 04:40:07 UTC. -- Oct 12 04:08:04.479567 dv-cinder-813067-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 12 04:08:04.488785 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 12 04:08:04.490636 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 12 04:08:04 2021] *** Oct 12 04:08:04.490636 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 12 04:08:04.490636 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 12 04:08:04.490636 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: nodename: dv-cinder-813067-1-iscsi Oct 12 04:08:04.490636 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: machine: x86_64 Oct 12 04:08:04.490636 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: clock source: unix Oct 12 04:08:04.490636 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: pcre jit disabled Oct 12 04:08:04.490636 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: detected number of CPU cores: 4 Oct 12 04:08:04.490636 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: current working directory: / Oct 12 04:08:04.490636 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: detected binary path: /usr/bin/uwsgi-core Oct 12 04:08:04.491722 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: your processes number limit is 47680 Oct 12 04:08:04.491722 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: your memory page size is 4096 bytes Oct 12 04:08:04.491722 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: detected max file descriptor number: 2048 Oct 12 04:08:04.491722 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: lock engine: pthread robust mutexes Oct 12 04:08:04.491722 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: thunder lock: enabled Oct 12 04:08:04.491722 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 12 04:08:04.491722 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 12 04:08:04.539978 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: Python main interpreter initialized at 0x5605136a79c0 Oct 12 04:08:04.539978 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: python threads support enabled Oct 12 04:08:04.539978 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: your server socket listen backlog is limited to 100 connections Oct 12 04:08:04.539978 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: your mercy for graceful operations on workers is 90 seconds Oct 12 04:08:04.540459 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: mapped 403077 bytes (393 KB) for 2 cores Oct 12 04:08:04.540459 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: *** Operational MODE: preforking *** Oct 12 04:08:04.540664 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: *** uWSGI is running in multiple interpreter mode *** Oct 12 04:08:04.540664 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: spawned uWSGI master process (pid: 93916) Oct 12 04:08:04.540878 dv-cinder-813067-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 12 04:08:04.541987 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: spawned uWSGI worker 1 (pid: 93917, cores: 1) Oct 12 04:08:04.541987 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: spawned uWSGI worker 2 (pid: 93918, cores: 1) Oct 12 04:08:04.541987 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 12 04:08:06.190845 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 04:08:06.190845 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: from cryptography.utils import int_from_bytes Oct 12 04:08:06.191500 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 04:08:06.191500 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: from cryptography.utils import int_from_bytes Oct 12 04:08:06.192404 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 04:08:06.192404 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: from cryptography.utils import int_from_bytes Oct 12 04:08:06.192912 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 04:08:06.192912 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: from cryptography.utils import int_from_bytes Oct 12 04:08:08.829943 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 04:08:08.830504 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 04:08:08.830904 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 04:08:08.830997 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 04:08:08.831077 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 04:08:08.831150 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 04:08:08.831221 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 04:08:08.831294 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 04:08:08.831359 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 04:08:08.831432 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 04:08:08.831650 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.831749 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.831942 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.832027 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.832257 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.832345 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.832572 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.832667 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.832896 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.832981 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.833208 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.833337 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.833523 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.833627 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.833832 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.833939 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.834160 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.834256 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.834407 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.834501 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.834740 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.834840 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.835063 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813067-1-iscsi {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.835150 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813067-1-iscsi {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.835380 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.835472 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.835682 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.835773 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.835985 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.836077 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.836295 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.836428 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.836595 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.836683 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.836907 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.836993 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.837208 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.837302 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.837703 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.837812 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.838128 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.838248 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.838430 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.838556 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.838757 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.838872 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.839089 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.839222 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.839397 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.839485 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.839700 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.839784 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.840010 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.840095 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.840319 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.840431 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.840632 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.840728 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.840931 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.841060 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.841320 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813067-1-iscsi {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.841413 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813067-1-iscsi {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.841628 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.842210 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.842444 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.842534 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.842770 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.842869 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.843176 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.843268 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.843481 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.843584 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.843784 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.843876 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.844097 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.844183 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.844415 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.844514 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.844719 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.844806 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.845038 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.845124 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.845352 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.845446 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.845663 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.845749 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.845980 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.846074 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.846275 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.846369 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.846578 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.846682 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.846902 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.846998 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.847217 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.847305 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.847518 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.847601 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.847816 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.847900 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.848060 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.848145 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.848366 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.848452 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.848680 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.848765 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.848994 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.849080 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.849308 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.849403 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.849554 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.849648 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.849796 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.849889 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.850110 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.850203 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.850426 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.850521 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.850749 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.850842 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.851052 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.851138 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.851351 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.851438 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.851650 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.851741 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.851949 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.852034 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.852248 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.852337 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.852547 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.852639 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.852847 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.852931 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.853156 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.853248 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.853466 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.853558 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.853780 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.853865 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.854082 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.854175 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.854393 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.854485 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.854804 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.21 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.854904 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.21 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.855052 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.21 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.855137 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.21 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.855352 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.855443 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.855686 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.855784 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.855995 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.856080 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.856299 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.856389 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.856613 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.856753 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.856928 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.857021 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.857227 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.857313 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.858088 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.858185 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.858395 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.858486 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.858731 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.858822 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.859059 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.859160 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.859360 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.859451 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.859603 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.859690 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.859898 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.860031 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.860195 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.860282 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.860506 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.860592 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.860807 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.860893 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.861104 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.861232 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.861404 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.861497 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.861696 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.861791 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.861996 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.862082 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.862295 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.862380 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.862593 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.862702 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.862919 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.863005 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.863223 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.863309 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.863527 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.863613 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.863832 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.863918 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.864136 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.864230 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.864440 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.864526 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.864748 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.864832 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.865064 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.865159 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.865366 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.865450 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.865665 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.865760 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.865964 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.866058 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.866265 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.866358 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.866576 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.866724 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.866900 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.867001 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.867202 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.867296 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.867518 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.867604 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.867821 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.867918 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.868124 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.868209 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.868434 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.868527 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.868737 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.868829 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.869033 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.869119 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.869348 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.869440 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.869644 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.869737 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.870220 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.870306 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.870531 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.870615 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.870857 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.870957 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.871160 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.871246 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.871455 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.871549 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.871753 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.871839 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.872049 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.872133 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.872347 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.872433 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.872642 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.872730 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.872963 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.873048 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.873263 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.873347 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.873575 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.873669 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.873891 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.873983 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.874192 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.874278 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.874494 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.874618 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.874815 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.874902 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.875129 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.875223 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:08:08.875459 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.875547 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.875784 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.875874 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.876123 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.876221 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.876432 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.876517 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.876762 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.876891 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.877088 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.877185 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.877402 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.877494 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.877707 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.877792 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.878016 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.878109 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.878340 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.878426 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.878645 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.878802 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.878974 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.879062 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.879281 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.879367 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.879593 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.879677 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.879904 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.879992 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.880228 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.880337 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.880541 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.880626 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.880853 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.880948 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.881165 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.881250 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.881471 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.881556 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.881782 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.881873 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.882102 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.882195 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.882417 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.882501 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.882746 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.882847 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.883084 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.883360 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.883447 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.883702 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.883796 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.884012 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.884098 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.884322 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.884407 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.884628 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.884769 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.884944 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.885036 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.885251 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.885336 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.885554 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.885646 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.885861 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.885954 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.886174 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.886266 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.886481 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.886568 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.886814 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.886902 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.887135 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.887220 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.887445 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.887531 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.887746 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.887831 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.888046 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.888131 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.888347 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.888433 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.888671 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.888764 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.888974 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.889067 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.889273 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.889365 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.889588 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.889684 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.889891 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.889984 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.890196 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.890282 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.890510 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.890594 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.890835 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.890932 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.891144 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.891229 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.891445 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.891572 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.891745 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.891842 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.892050 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.892142 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.892353 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.892440 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.892651 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.892753 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.892968 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.893067 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.893269 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.893354 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.893567 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.893653 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.893875 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.893967 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.894174 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.894258 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.894475 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.894563 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.894810 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.894909 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.895117 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.895204 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.895423 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.895509 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.895727 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.895812 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.896038 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.896122 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.896343 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.896428 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.896648 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.896744 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.896976 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.897110 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.897281 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.897367 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.897592 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.897677 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.897914 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.898010 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.898229 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.898315 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.898533 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.898618 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.898857 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.898957 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.899160 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.899252 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.899460 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.899546 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.899761 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.899859 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.900062 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.900148 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.900363 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.900448 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.900662 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.900759 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.900961 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.901046 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.901261 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.901346 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.901560 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.901684 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.901857 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.901944 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.902172 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.902258 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.902476 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.902566 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.902801 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.902891 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.903102 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.903197 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.903400 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.903493 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.903730 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.903815 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.904029 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.904114 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.904891 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.904987 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.905219 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.905305 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.905531 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.905615 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.905841 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.905927 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.906146 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.906231 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.906452 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.906544 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.906783 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.906884 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.907093 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.907217 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.907398 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.907493 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.907705 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.907792 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.908012 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.908097 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.908314 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.908413 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.908622 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.908708 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.908927 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.909013 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.909239 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.909336 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.909542 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.909632 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.909843 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.909934 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.910141 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.910235 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.910451 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.910537 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.910810 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.910899 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.911124 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.911210 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.911441 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.911526 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.911746 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.911830 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.912054 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.912140 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.912360 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.912446 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.912663 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.912748 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.912966 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.913053 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.913268 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.913353 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.913573 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.913665 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.913877 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.913969 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.914181 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.914267 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.914487 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.914571 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.914812 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.914901 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.915134 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.915219 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.915438 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.915540 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.915738 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.915824 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.916040 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.916125 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.916349 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.916447 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.916671 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.916758 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.916978 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.917062 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.917285 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.917384 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.917590 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.917675 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.917894 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.917979 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.918197 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.918290 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.918501 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.918595 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.918829 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.918919 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.919127 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.919214 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.919427 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.919513 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.919731 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.920396 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.920574 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.920662 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.920879 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.920963 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.921178 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.921263 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.921475 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.921561 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.921782 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.921868 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.922084 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.922169 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.922383 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.922469 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.922699 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.922788 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.923009 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.923095 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.923314 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.923401 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.923618 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.923703 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.923934 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.924034 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.924233 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.924325 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.924533 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.924620 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.924829 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.924923 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.925146 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.925232 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.925444 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.925536 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.925739 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.925831 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.926037 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.926121 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.926332 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.926417 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.926684 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.926784 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.926991 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.927078 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.927289 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.927414 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.927600 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.927700 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.927905 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.927992 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.928210 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.928294 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.928515 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.928601 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.928820 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.928913 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.929122 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.929208 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.929433 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.929519 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.929738 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.929825 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.930041 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.930126 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.930343 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.930429 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.930646 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.930752 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.930974 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.931060 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.931277 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.931364 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.931583 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.931669 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.931884 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.932046 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.932188 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.932275 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.932488 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.932583 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.932785 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.932879 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.933088 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.933180 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.933400 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.933644 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.933952 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.934051 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.934268 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.934354 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.934575 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.934687 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.934915 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.935020 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.935232 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.935318 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.935569 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.935658 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.935891 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.935978 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.936202 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.936288 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.936505 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.936591 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.936803 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.936896 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.937102 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.937187 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.937399 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.937525 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.937698 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.937786 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.937996 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.938081 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.938292 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.938376 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.938590 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.938724 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.938911 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.938997 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.939211 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.939296 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.939506 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.939593 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.939805 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.939891 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.940124 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.940224 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.940422 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.940540 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.940724 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.940817 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.941017 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.941110 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.941320 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.941406 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.941615 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.941709 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.941933 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.942020 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.942232 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.942324 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.942531 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.942617 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.942855 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.942949 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.943156 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.943242 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.943483 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.943569 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.943785 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.943871 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.944116 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.944211 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.944440 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.944527 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.944740 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.944825 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.945047 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.945145 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.945351 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.945442 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.945655 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.945740 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.945957 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.946053 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.946255 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.946341 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.946551 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.946636 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.946880 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.946983 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.947180 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.947265 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.947475 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.947561 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.947777 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.947863 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.948078 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.948170 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.948380 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.948466 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.948678 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.948766 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.948974 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.949067 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.949271 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.949356 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.949566 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.949652 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.949874 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.949959 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.950174 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.950259 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.950471 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.950564 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.950798 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.950898 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.951128 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.951218 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.951431 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.951518 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.951728 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.951813 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.952026 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.952118 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.952322 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.952409 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.952625 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.952709 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.952922 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.953015 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.953220 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.953312 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.953517 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.953605 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.953822 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.953916 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.954119 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.954211 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.954415 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.954511 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.954756 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.954858 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.955062 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.955154 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.955362 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.955504 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.955662 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.955821 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.955958 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.956044 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.956258 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.956344 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.956562 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.956656 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.956873 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.956958 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.957174 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.957299 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.957472 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.957558 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.957770 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.957863 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.958066 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.958158 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.958364 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.958450 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.958691 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.958789 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.958988 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.959081 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.959283 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.959369 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.959579 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.959665 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.959873 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.960004 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.960169 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.960263 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.960467 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.960554 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.960776 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.960870 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.961076 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.961163 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.961372 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.961457 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.961667 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.961765 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.961961 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.962058 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.962295 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.962382 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.962596 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.962733 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.962963 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.963055 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.963262 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.963348 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.963573 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.963668 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.963878 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.963963 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.964182 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.964267 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.964488 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.964575 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.964789 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.964881 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.965088 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.965173 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.965400 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.965488 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.965708 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.965793 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.966011 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.966097 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.966306 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.966392 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.966604 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.967211 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.967493 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.967579 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.967801 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.967935 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.968121 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.968208 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.968441 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.968535 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.968762 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.968849 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.969065 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.969160 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.969372 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.969467 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.969678 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.969764 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.969982 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.970069 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.970286 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.970380 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.970590 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.970693 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.970918 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.971003 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.971225 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.971325 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.971531 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.971616 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.971836 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.971922 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.972141 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.972238 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.972442 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.972528 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.972738 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.972823 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.973042 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.973141 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.973342 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.973442 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.973641 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.973735 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.973957 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.974043 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.974256 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.974343 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.974554 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.974639 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.974877 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.974965 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.975177 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.975265 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.975477 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.975563 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.975774 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.975898 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.976205 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.976447 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.976535 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.976758 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.976853 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.977067 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.977153 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.977368 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.977457 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.977673 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.977760 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.977979 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.978071 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.978280 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.978366 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.978587 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.978697 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.978910 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.979009 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.979307 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.979415 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.979616 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.979704 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.979918 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.980004 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.980219 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.980305 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.980519 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.980606 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.980821 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.980907 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.981124 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.981217 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.981425 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.981513 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.981727 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.981813 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.982026 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.982119 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.982377 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.982966 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.983206 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.983295 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.983529 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.983624 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.983850 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.983944 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.984204 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.984513 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.984607 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.984829 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.984923 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.985133 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.985219 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.985507 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.985667 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.985830 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.985921 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.986136 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.986222 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.986441 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.986539 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.986775 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.986879 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.987084 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.987172 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.987392 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.987485 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.987702 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.987814 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.988006 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.988099 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.988319 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.988414 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.988621 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.988708 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.988930 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.989016 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.989248 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.989347 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.989549 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.989634 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.989867 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.989952 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.990187 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.990280 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.990497 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.990583 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.990837 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.990925 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.991216 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.991303 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.991542 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.991643 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.991847 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.991935 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.992151 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.992237 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.992459 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.992548 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.992762 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.992850 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.993065 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.993151 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.993375 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.993464 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.993676 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.993761 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.993975 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.994061 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.994284 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.994378 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.994584 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.994689 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.995184 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.995276 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.995487 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.995583 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.995792 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.995878 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.996093 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.996254 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.996395 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.996490 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.996709 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.996794 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.997008 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.997106 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.997326 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.997421 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.997627 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.997766 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.997966 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.998068 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.998274 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.998364 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.998576 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.998679 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.998902 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.999002 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.999204 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.999300 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.999508 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.999600 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.999808 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:08.999905 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.000107 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.000195 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.000445 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.000543 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.000748 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.000842 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.001061 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.001147 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.001385 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.001478 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.001708 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.001798 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.002011 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.002098 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.002324 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.002411 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.002648 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.002804 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.002972 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.003066 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.003274 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.003361 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.003582 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.003678 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.003880 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.003965 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.004179 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.004279 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.004479 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.004566 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.004778 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.004864 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.005077 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.005171 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.005418 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.005511 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.005680 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.005767 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.005976 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.006070 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.006277 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.006363 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.006576 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.006681 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.006916 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.007016 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.007218 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.007310 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.007518 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.007610 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.007818 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.007906 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.008119 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.008212 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.008419 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.008505 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.008717 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.008805 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.009053 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.009141 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.009360 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.009446 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.009683 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.009770 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.009989 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.010083 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.010306 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.010431 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.010618 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.010723 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.010957 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.011046 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.011270 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.011357 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.011582 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.011669 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.011892 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.011978 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.012202 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.012296 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.012512 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.012598 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.012820 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.012905 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.013129 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.013222 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.013438 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.014024 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.014256 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.014346 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.014571 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.014789 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.014891 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.015120 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.015208 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.015437 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.015704 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.015804 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.016029 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.016116 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.016340 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.016428 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.016650 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.016738 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.016961 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.017047 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.017269 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.017354 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.017577 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.017665 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.017883 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.017968 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.018191 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.018277 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.018498 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.018588 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.018841 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.018942 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.019167 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.019263 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.019482 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.019569 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.019798 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.019891 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.020113 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.020209 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.020425 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.020565 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.020733 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.020820 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.021045 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.021133 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.021355 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.021442 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.021665 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.021757 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.021976 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.022065 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.022287 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.022374 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.022596 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.022708 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.022929 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.023024 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.023236 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.023323 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.023544 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.023639 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.023849 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.023944 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.024158 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.024250 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.024466 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.024566 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.024774 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.024862 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.025082 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.025176 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.025391 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.025551 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.025703 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.025791 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.026022 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.026110 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.026333 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.026426 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.026648 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.026764 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.026980 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.027178 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.027293 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.027488 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.027605 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.027818 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.028112 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.028198 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.028423 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.028510 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.028753 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.028849 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.029064 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.029199 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.029932 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.030023 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.030239 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.030326 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.030543 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.030745 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.030881 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.030969 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.031190 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.031280 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.031493 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.031590 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.031801 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.031888 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.032110 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.032196 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.032411 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.032505 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.032729 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.032817 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.033037 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.033123 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.033339 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.033559 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.033647 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.033900 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.033987 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.034214 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.034462 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.034550 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.034822 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.034913 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.035139 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.035237 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.035462 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.035551 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.035780 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.035866 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.036093 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.036180 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.036396 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.036483 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.036708 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.036793 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.037010 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.037096 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.037310 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.037408 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.037613 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.037699 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.037918 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.038012 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.038220 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.038311 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.038518 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.038604 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.038848 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.038953 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.039151 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.039238 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.039449 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.039535 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.039762 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.039859 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.040063 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.040150 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.040365 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.040457 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.040672 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.040757 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.040972 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.041065 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.041272 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.041358 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.041572 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.041667 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.041872 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.041958 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.042173 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.042260 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.042471 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.042558 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.042793 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.042882 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.043098 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.043183 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.043397 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.043486 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.043697 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.043783 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.043996 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.044081 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.044295 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.044389 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.044594 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.044686 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.044925 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.045023 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.045227 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.045315 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.045540 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.045633 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.045841 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.045928 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.046142 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.046230 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.046455 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.046548 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.046787 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.046888 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.047107 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.047194 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.047416 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.047503 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.047721 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.047948 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.048061 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.048281 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.048369 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.048644 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.048890 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.048991 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.049221 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.049309 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.049579 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.049666 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.049896 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.049991 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.050202 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.050289 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.050526 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.050613 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.050853 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.050942 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.051158 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.051248 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.051466 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.051551 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.051777 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.051889 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.052084 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.052171 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.052388 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.052474 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.052694 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.052787 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.053000 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.053086 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.053305 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.053391 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.053611 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.053700 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.053916 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.054007 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.054222 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.054318 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.054548 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.054634 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.054888 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.054976 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.055196 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.055357 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.055507 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.055594 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.055815 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.055927 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.056120 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.056221 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.056426 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.056561 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.056733 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.056821 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.057041 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.057138 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.057342 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.057428 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.057665 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.057751 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.057975 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.058064 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.058277 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.058366 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.058657 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.058801 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.058990 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.059079 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.059311 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.059398 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.059624 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.059717 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.059930 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.060025 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.060247 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.060333 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.060579 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.060677 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.060892 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.060978 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.061212 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.061299 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.061522 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.061618 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.061848 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.061942 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.062149 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.062236 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.062455 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.062551 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.062789 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.062880 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.063102 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.063189 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.063418 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.063505 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.063720 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.063813 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.064039 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.064341 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.064438 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.064659 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.064751 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.064967 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.065054 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.065286 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.065382 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.065593 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.065679 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.065903 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.065990 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.066209 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.066303 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.066529 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.066616 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.066864 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.066951 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.067173 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.067262 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.067480 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.067569 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.067785 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.067872 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.068091 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.068179 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.068398 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.068485 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.068704 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.068796 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.069010 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.069098 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.069316 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.069403 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.069622 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.069719 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.069938 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.070025 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.070256 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.070350 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.070556 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.070651 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.070897 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.071030 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.071209 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.071304 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.071523 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.071618 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.071832 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.071919 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.072138 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.072230 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.072448 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.072536 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.072754 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.072846 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.073064 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.073149 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.073368 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.073462 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.073673 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.073760 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.073983 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.074071 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.074294 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.074389 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.074616 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.074740 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.074962 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.075050 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.075284 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.075373 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.075606 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.075700 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.075912 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 04:08:09.076007 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.076758 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.077097 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.077420 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:08:09.077659 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 04:08:09.099749 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG oslo_db.sqlalchemy.engines [None req-4ea99d4a-77bd-4693-bc5d-565cf53099ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 04:08:09.103994 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG oslo_db.sqlalchemy.engines [None req-f4196b19-10e6-48c4-97da-1b8f34738a3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93917) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 04:08:09.276235 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.context [None req-4ea99d4a-77bd-4693-bc5d-565cf53099ff None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),455ec794-f329-435f-873e-870ca7b342b6(cell1) {{(pid=93918) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 04:08:09.277507 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.context [None req-f4196b19-10e6-48c4-97da-1b8f34738a3d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),455ec794-f329-435f-873e-870ca7b342b6(cell1) {{(pid=93917) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 04:08:09.281259 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG oslo_concurrency.lockutils [None req-4ea99d4a-77bd-4693-bc5d-565cf53099ff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:08:09.282422 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG oslo_concurrency.lockutils [None req-f4196b19-10e6-48c4-97da-1b8f34738a3d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:08:09.282960 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG oslo_concurrency.lockutils [None req-4ea99d4a-77bd-4693-bc5d-565cf53099ff None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:08:09.283762 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG oslo_concurrency.lockutils [None req-4ea99d4a-77bd-4693-bc5d-565cf53099ff None None] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:08:09.284015 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG oslo_concurrency.lockutils [None req-f4196b19-10e6-48c4-97da-1b8f34738a3d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:08:09.284804 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG oslo_concurrency.lockutils [None req-f4196b19-10e6-48c4-97da-1b8f34738a3d None None] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:08:09.285691 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG oslo_concurrency.lockutils [None req-4ea99d4a-77bd-4693-bc5d-565cf53099ff None None] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:08:09.286724 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG oslo_concurrency.lockutils [None req-f4196b19-10e6-48c4-97da-1b8f34738a3d None None] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:08:09.295796 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG oslo_db.sqlalchemy.engines [None req-4ea99d4a-77bd-4693-bc5d-565cf53099ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 04:08:09.298251 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG oslo_db.sqlalchemy.engines [None req-4ea99d4a-77bd-4693-bc5d-565cf53099ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 04:08:09.302073 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG oslo_db.sqlalchemy.engines [None req-f4196b19-10e6-48c4-97da-1b8f34738a3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93917) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 04:08:09.306615 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG oslo_db.sqlalchemy.engines [None req-f4196b19-10e6-48c4-97da-1b8f34738a3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93917) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 04:08:09.567976 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG oslo_db.sqlalchemy.engines [None req-f4196b19-10e6-48c4-97da-1b8f34738a3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93917) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 04:08:09.572539 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG oslo_db.sqlalchemy.engines [None req-4ea99d4a-77bd-4693-bc5d-565cf53099ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 04:08:09.998623 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: WARNING keystonemiddleware.auth_token [None req-f4196b19-10e6-48c4-97da-1b8f34738a3d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 04:08:10.005206 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: WARNING keystonemiddleware.auth_token [None req-f4196b19-10e6-48c4-97da-1b8f34738a3d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 04:08:10.015208 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: WARNING keystonemiddleware.auth_token [None req-4ea99d4a-77bd-4693-bc5d-565cf53099ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 04:08:10.022092 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: WARNING keystonemiddleware.auth_token [None req-4ea99d4a-77bd-4693-bc5d-565cf53099ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 04:08:10.348619 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: WARNING keystonemiddleware.auth_token [None req-f4196b19-10e6-48c4-97da-1b8f34738a3d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 04:08:10.353760 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: WARNING keystonemiddleware.auth_token [None req-f4196b19-10e6-48c4-97da-1b8f34738a3d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 04:08:10.359731 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5605136a79c0 pid: 93917 (default app) Oct 12 04:08:10.361772 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-f4196b19-10e6-48c4-97da-1b8f34738a3d None None] Calling method '>' {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:08:10.362970 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-f4196b19-10e6-48c4-97da-1b8f34738a3d None None] 10.222.0.21 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001708 Oct 12 04:08:10.363387 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 1/1] 10.222.0.21 () {50 vars in 788 bytes} [Tue Oct 12 04:08:10 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:08:10.364693 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: WARNING keystonemiddleware.auth_token [None req-4ea99d4a-77bd-4693-bc5d-565cf53099ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 04:08:10.370095 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: WARNING keystonemiddleware.auth_token [None req-4ea99d4a-77bd-4693-bc5d-565cf53099ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 04:08:10.375440 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5605136a79c0 pid: 93918 (default app) Oct 12 04:09:34.181127 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-f4196b19-10e6-48c4-97da-1b8f34738a3d None None] Calling method '>' {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:09:34.182251 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-f4196b19-10e6-48c4-97da-1b8f34738a3d None None] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Oct 12 04:09:34.183042 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 2/2] 10.222.0.21 () {54 vars in 930 bytes} [Tue Oct 12 04:09:34 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:09:34.597571 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-7d1e8e14-29c5-4f71-9cc0-0b2613b860d1 admin admin] Calling method '>' {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:09:34.627465 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-7d1e8e14-29c5-4f71-9cc0-0b2613b860d1 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.434572 Oct 12 04:09:34.627933 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 1/3] 10.222.0.21 () {60 vars in 1291 bytes} [Tue Oct 12 04:09:34 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:09:37.005904 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-f4196b19-10e6-48c4-97da-1b8f34738a3d None None] Calling method '>' {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:09:37.006980 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-f4196b19-10e6-48c4-97da-1b8f34738a3d None None] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Oct 12 04:09:37.007335 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 3/4] 10.222.0.21 () {54 vars in 930 bytes} [Tue Oct 12 04:09:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:09:37.068243 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-b6226e35-eea9-48aa-a90b-31ae111b3f08 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "id": "c1", "name": "cirros256", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:09:37.086432 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:09:37.086432 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: warnings.warn(msg) Oct 12 04:09:37.188543 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-b6226e35-eea9-48aa-a90b-31ae111b3f08 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.174103 Oct 12 04:09:37.189292 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 2/5] 10.222.0.21 () {64 vars in 1282 bytes} [Tue Oct 12 04:09:37 2021] POST /compute/v2.1/flavors => generated 407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:09:37.406828 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-493b8052-baee-4916-9534-8244c812b3ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:09:37.409143 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:09:37.409143 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: warnings.warn(msg) Oct 12 04:09:37.536671 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-493b8052-baee-4916-9534-8244c812b3ad admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.338450 Oct 12 04:09:37.545200 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 4/6] 10.222.0.21 () {64 vars in 1335 bytes} [Tue Oct 12 04:09:37 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:09:39.858080 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-b6226e35-eea9-48aa-a90b-31ae111b3f08 admin admin] Calling method '>' {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:09:39.859249 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-b6226e35-eea9-48aa-a90b-31ae111b3f08 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001603 Oct 12 04:09:39.859933 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 3/7] 10.222.0.21 () {54 vars in 930 bytes} [Tue Oct 12 04:09:39 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:09:39.977687 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-ea0d7dcb-e0e7-4ac6-b7c1-af126d06fd2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "rxtx_factor": 1.0, "disk": 5, "name": "ds512M", "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:09:39.998976 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:09:39.998976 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: warnings.warn(msg) Oct 12 04:09:40.093852 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-ea0d7dcb-e0e7-4ac6-b7c1-af126d06fd2c admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.227252 Oct 12 04:09:40.094730 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 5/8] 10.222.0.21 () {64 vars in 1282 bytes} [Tue Oct 12 04:09:39 2021] POST /compute/v2.1/flavors => generated 404 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:09:40.106949 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-b74b39ee-4d41-4228-aa72-2ee348033b97 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:09:40.109018 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:09:40.109018 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: warnings.warn(msg) Oct 12 04:09:40.227330 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-b74b39ee-4d41-4228-aa72-2ee348033b97 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.123963 Oct 12 04:09:40.228186 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 4/9] 10.222.0.21 () {64 vars in 1335 bytes} [Tue Oct 12 04:09:40 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:09:42.565582 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-ea0d7dcb-e0e7-4ac6-b7c1-af126d06fd2c admin admin] Calling method '>' {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:09:42.566593 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-ea0d7dcb-e0e7-4ac6-b7c1-af126d06fd2c admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 12 04:09:42.567097 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 6/10] 10.222.0.21 () {54 vars in 930 bytes} [Tue Oct 12 04:09:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:09:42.629375 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-1866dbb0-5856-408c-b1ca-a648d1d20d28 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 1024, "id": "d2", "name": "ds1G", "disk": 10, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:09:42.721146 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-1866dbb0-5856-408c-b1ca-a648d1d20d28 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.146783 Oct 12 04:09:42.721829 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 5/11] 10.222.0.21 () {64 vars in 1282 bytes} [Tue Oct 12 04:09:42 2021] POST /compute/v2.1/flavors => generated 404 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:09:42.738148 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-8c9cff6d-ca9f-48b3-a62c-440f2f4c020d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:09:42.822550 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-8c9cff6d-ca9f-48b3-a62c-440f2f4c020d admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091594 Oct 12 04:09:42.823179 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 7/12] 10.222.0.21 () {64 vars in 1335 bytes} [Tue Oct 12 04:09:42 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:09:45.107511 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-1866dbb0-5856-408c-b1ca-a648d1d20d28 admin admin] Calling method '>' {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:09:45.109198 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-1866dbb0-5856-408c-b1ca-a648d1d20d28 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002207 Oct 12 04:09:45.109841 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 6/13] 10.222.0.21 () {54 vars in 930 bytes} [Tue Oct 12 04:09:45 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:09:45.171688 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-54c5ea29-5529-4113-8016-d070449d58c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "d3", "os-flavor-access:is_public": true, "disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:09:45.228838 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-54c5ea29-5529-4113-8016-d070449d58c7 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.112146 Oct 12 04:09:45.229378 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 8/14] 10.222.0.21 () {64 vars in 1282 bytes} [Tue Oct 12 04:09:45 2021] POST /compute/v2.1/flavors => generated 404 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:09:45.241474 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-831d17f4-a1fd-4ea3-a099-ad5b54a80dc2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:09:45.318721 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-831d17f4-a1fd-4ea3-a099-ad5b54a80dc2 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080760 Oct 12 04:09:45.319309 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 7/15] 10.222.0.21 () {64 vars in 1335 bytes} [Tue Oct 12 04:09:45 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:09:47.613511 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-54c5ea29-5529-4113-8016-d070449d58c7 admin admin] Calling method '>' {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:09:47.614537 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-54c5ea29-5529-4113-8016-d070449d58c7 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 12 04:09:47.614988 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 9/16] 10.222.0.21 () {54 vars in 930 bytes} [Tue Oct 12 04:09:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:09:47.675872 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-3703b346-c84a-4575-afc9-cd28feeec9f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "rxtx_factor": 1.0, "name": "ds4G", "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 4, "swap": 0}} {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:09:47.762533 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-3703b346-c84a-4575-afc9-cd28feeec9f9 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140330 Oct 12 04:09:47.763113 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 8/17] 10.222.0.21 () {64 vars in 1282 bytes} [Tue Oct 12 04:09:47 2021] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:09:47.775707 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-7f455a4b-475a-460c-a823-ae50f379983d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:09:47.834598 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-7f455a4b-475a-460c-a823-ae50f379983d admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062617 Oct 12 04:09:47.835576 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 10/18] 10.222.0.21 () {64 vars in 1335 bytes} [Tue Oct 12 04:09:47 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:09:50.122995 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-3703b346-c84a-4575-afc9-cd28feeec9f9 admin admin] Calling method '>' {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:09:50.124001 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-3703b346-c84a-4575-afc9-cd28feeec9f9 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Oct 12 04:09:50.124406 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 9/19] 10.222.0.21 () {54 vars in 930 bytes} [Tue Oct 12 04:09:50 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:09:50.181803 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-fcab3904-c2b5-401a-a3cc-8b98c7a7ea94 admin admin] Calling method '>' {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:09:50.204749 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-fcab3904-c2b5-401a-a3cc-8b98c7a7ea94 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.073880 Oct 12 04:09:50.205290 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 11/20] 10.222.0.21 () {60 vars in 1291 bytes} [Tue Oct 12 04:09:50 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:09:52.554237 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-3703b346-c84a-4575-afc9-cd28feeec9f9 admin admin] Calling method '>' {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:09:52.555304 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-3703b346-c84a-4575-afc9-cd28feeec9f9 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001615 Oct 12 04:09:52.555714 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 10/21] 10.222.0.21 () {54 vars in 930 bytes} [Tue Oct 12 04:09:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:09:52.622314 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-88b794c4-8a2f-4a5d-83ba-ec79bc3e1d2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "1", "ram": 512, "name": "m1.tiny", "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:09:52.732814 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-88b794c4-8a2f-4a5d-83ba-ec79bc3e1d2e admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.170231 Oct 12 04:09:52.733473 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 12/22] 10.222.0.21 () {64 vars in 1282 bytes} [Tue Oct 12 04:09:52 2021] POST /compute/v2.1/flavors => generated 402 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:09:52.746145 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-d00a046c-a6f4-46b6-bd86-7576f70d1a17 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:09:52.835975 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-d00a046c-a6f4-46b6-bd86-7576f70d1a17 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093554 Oct 12 04:09:52.836765 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 11/23] 10.222.0.21 () {64 vars in 1332 bytes} [Tue Oct 12 04:09:52 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:09:55.129527 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-88b794c4-8a2f-4a5d-83ba-ec79bc3e1d2e admin admin] Calling method '>' {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:09:55.130518 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-88b794c4-8a2f-4a5d-83ba-ec79bc3e1d2e admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 12 04:09:55.130973 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 13/24] 10.222.0.21 () {54 vars in 930 bytes} [Tue Oct 12 04:09:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:09:55.193642 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-2f9de07e-2c13-4293-8df2-e84ce8875fce admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 2048, "id": "2", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:09:55.281947 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-2f9de07e-2c13-4293-8df2-e84ce8875fce admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.142792 Oct 12 04:09:55.282632 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 12/25] 10.222.0.21 () {64 vars in 1282 bytes} [Tue Oct 12 04:09:55 2021] POST /compute/v2.1/flavors => generated 405 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:09:55.295603 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-d0a521db-08e8-4d3c-98eb-63c665dd7f0f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:09:55.393291 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-d0a521db-08e8-4d3c-98eb-63c665dd7f0f admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101991 Oct 12 04:09:55.394044 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 14/26] 10.222.0.21 () {64 vars in 1332 bytes} [Tue Oct 12 04:09:55 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:09:57.717921 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-2f9de07e-2c13-4293-8df2-e84ce8875fce admin admin] Calling method '>' {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:09:57.718957 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-2f9de07e-2c13-4293-8df2-e84ce8875fce admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Oct 12 04:09:57.719504 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 13/27] 10.222.0.21 () {54 vars in 930 bytes} [Tue Oct 12 04:09:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:09:57.777875 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-1d8f7663-8352-47be-a80e-10ba0c38974b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 2, "swap": 0, "id": "3", "rxtx_factor": 1.0, "disk": 40}} {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:09:57.858917 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-1d8f7663-8352-47be-a80e-10ba0c38974b admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.133220 Oct 12 04:09:57.859495 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 15/28] 10.222.0.21 () {64 vars in 1282 bytes} [Tue Oct 12 04:09:57 2021] POST /compute/v2.1/flavors => generated 406 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:09:57.871991 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-ac59a0ff-c773-4409-8671-51c6f67ef756 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:09:57.982885 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-ac59a0ff-c773-4409-8671-51c6f67ef756 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114638 Oct 12 04:09:57.983481 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 14/29] 10.222.0.21 () {64 vars in 1332 bytes} [Tue Oct 12 04:09:57 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:10:00.339833 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-1d8f7663-8352-47be-a80e-10ba0c38974b admin admin] Calling method '>' {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:10:00.341354 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-1d8f7663-8352-47be-a80e-10ba0c38974b admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 12 04:10:00.341754 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 16/30] 10.222.0.21 () {54 vars in 930 bytes} [Tue Oct 12 04:10:00 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:10:00.412928 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-c6346fc7-08be-4efc-9f66-86d55c87f4e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.large", "vcpus": 4, "os-flavor-access:is_public": true, "ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "rxtx_factor": 1.0}} {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:10:00.499581 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-c6346fc7-08be-4efc-9f66-86d55c87f4e3 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.151095 Oct 12 04:10:00.507339 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 15/31] 10.222.0.21 () {64 vars in 1282 bytes} [Tue Oct 12 04:10:00 2021] POST /compute/v2.1/flavors => generated 405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:10:00.512792 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-8735662b-bf77-4b9f-9ebd-0d4545e12908 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:10:00.598617 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-8735662b-bf77-4b9f-9ebd-0d4545e12908 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089512 Oct 12 04:10:00.599270 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 17/32] 10.222.0.21 () {64 vars in 1332 bytes} [Tue Oct 12 04:10:00 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:10:02.926065 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-c6346fc7-08be-4efc-9f66-86d55c87f4e3 admin admin] Calling method '>' {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:10:02.927181 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-c6346fc7-08be-4efc-9f66-86d55c87f4e3 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Oct 12 04:10:02.927581 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 16/33] 10.222.0.21 () {54 vars in 930 bytes} [Tue Oct 12 04:10:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:10:02.988980 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-5cacad76-8b21-421d-841b-d7dd6fce4765 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "name": "m1.xlarge", "swap": 0, "id": "5", "os-flavor-access:is_public": true, "vcpus": 8, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:10:03.070961 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-5cacad76-8b21-421d-841b-d7dd6fce4765 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.136932 Oct 12 04:10:03.072077 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 18/34] 10.222.0.21 () {64 vars in 1282 bytes} [Tue Oct 12 04:10:02 2021] POST /compute/v2.1/flavors => generated 408 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:10:03.090437 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-a8d46064-d70b-4124-a420-59136afadfc5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:10:03.201324 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-a8d46064-d70b-4124-a420-59136afadfc5 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119346 Oct 12 04:10:03.202053 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 17/35] 10.222.0.21 () {64 vars in 1332 bytes} [Tue Oct 12 04:10:03 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:10:42.238907 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-5cacad76-8b21-421d-841b-d7dd6fce4765 admin admin] Calling method '>' {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:10:42.239929 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-5cacad76-8b21-421d-841b-d7dd6fce4765 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Oct 12 04:10:42.240320 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 19/36] 10.222.0.21 () {54 vars in 930 bytes} [Tue Oct 12 04:10:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:10:42.297204 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-b209e8f8-d68f-4f9e-8d41-44def5ab1eee admin admin] Calling method '>' {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:10:42.315258 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-b209e8f8-d68f-4f9e-8d41-44def5ab1eee admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067569 Oct 12 04:10:42.315809 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 18/37] 10.222.0.21 () {60 vars in 1291 bytes} [Tue Oct 12 04:10:42 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:10:43.820806 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-5cacad76-8b21-421d-841b-d7dd6fce4765 admin admin] Calling method '>' {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:10:43.821796 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-5cacad76-8b21-421d-841b-d7dd6fce4765 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Oct 12 04:10:43.822190 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 20/38] 10.222.0.21 () {56 vars in 1074 bytes} [Tue Oct 12 04:10:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:10:44.016811 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-19c9cf49-a860-4ab4-a87f-1f4966861544 admin admin] Calling method '>' {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:10:44.022145 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.wsgi [None req-19c9cf49-a860-4ab4-a87f-1f4966861544 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 12 04:10:44.022721 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-19c9cf49-a860-4ab4-a87f-1f4966861544 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:10:44.023510 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-19c9cf49-a860-4ab4-a87f-1f4966861544 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058829 Oct 12 04:10:44.024020 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 19/39] 10.222.0.21 () {60 vars in 1190 bytes} [Tue Oct 12 04:10:43 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 04:10:44.034132 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-9940b308-3ac8-48ec-b8a6-2f54d5243089 admin admin] Calling method '>' {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:10:44.055993 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-9940b308-3ac8-48ec-b8a6-2f54d5243089 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025343 Oct 12 04:10:44.056531 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 21/40] 10.222.0.21 () {60 vars in 1210 bytes} [Tue Oct 12 04:10:44 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:10:44.066795 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-43a7cab8-9222-4766-99ab-f729a9fd7397 admin admin] Calling method '>' {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:10:44.086946 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-43a7cab8-9222-4766-99ab-f729a9fd7397 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023906 Oct 12 04:10:44.087466 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 20/41] 10.222.0.21 () {60 vars in 1210 bytes} [Tue Oct 12 04:10:44 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:10:44.097356 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-601b0037-8336-47dd-ba5f-b34b6788c289 admin admin] Calling method '>' {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:10:44.102487 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.wsgi [None req-601b0037-8336-47dd-ba5f-b34b6788c289 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 12 04:10:44.103075 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-601b0037-8336-47dd-ba5f-b34b6788c289 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:10:44.103849 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-601b0037-8336-47dd-ba5f-b34b6788c289 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.009935 Oct 12 04:10:44.104331 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 22/42] 10.222.0.21 () {60 vars in 1190 bytes} [Tue Oct 12 04:10:44 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 04:10:45.521789 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-43a7cab8-9222-4766-99ab-f729a9fd7397 admin admin] Calling method '>' {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:10:45.522926 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-43a7cab8-9222-4766-99ab-f729a9fd7397 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 12 04:10:45.523319 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 21/43] 10.222.0.21 () {56 vars in 1074 bytes} [Tue Oct 12 04:10:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:10:45.716672 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-9865ee0a-5b5d-4eb8-8028-3c99f38568f3 admin admin] Calling method '>' {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:10:45.722172 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.wsgi [None req-9865ee0a-5b5d-4eb8-8028-3c99f38568f3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 12 04:10:45.722750 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-9865ee0a-5b5d-4eb8-8028-3c99f38568f3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:10:45.723526 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-9865ee0a-5b5d-4eb8-8028-3c99f38568f3 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058815 Oct 12 04:10:45.724022 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 23/44] 10.222.0.21 () {60 vars in 1190 bytes} [Tue Oct 12 04:10:45 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 04:10:45.733868 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-ba0fb164-2c78-4ebb-bb35-977b3a62d740 admin admin] Calling method '>' {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:10:45.747197 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-ba0fb164-2c78-4ebb-bb35-977b3a62d740 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017111 Oct 12 04:10:45.747722 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 22/45] 10.222.0.21 () {60 vars in 1210 bytes} [Tue Oct 12 04:10:45 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:10:45.757631 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-0e2f95e1-7b11-4df1-b641-4884d85d1e87 admin admin] Calling method '>' {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:10:45.771887 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-0e2f95e1-7b11-4df1-b641-4884d85d1e87 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017698 Oct 12 04:10:45.772428 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 24/46] 10.222.0.21 () {60 vars in 1210 bytes} [Tue Oct 12 04:10:45 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:10:45.782892 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-59d7b029-6839-499a-a5fa-0ff3b30d41a5 admin admin] Calling method '>' {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:10:45.787973 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.wsgi [None req-59d7b029-6839-499a-a5fa-0ff3b30d41a5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 12 04:10:45.788969 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-59d7b029-6839-499a-a5fa-0ff3b30d41a5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:10:45.789366 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-59d7b029-6839-499a-a5fa-0ff3b30d41a5 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009986 Oct 12 04:10:45.789856 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 23/47] 10.222.0.21 () {60 vars in 1190 bytes} [Tue Oct 12 04:10:45 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 04:10:47.193023 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-0e2f95e1-7b11-4df1-b641-4884d85d1e87 admin admin] Calling method '>' {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:10:47.193998 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-0e2f95e1-7b11-4df1-b641-4884d85d1e87 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001390 Oct 12 04:10:47.194379 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 25/48] 10.222.0.21 () {56 vars in 1074 bytes} [Tue Oct 12 04:10:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:10:47.389122 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-e2bd9007-dc8d-45bf-b38b-a03bd9969d54 admin admin] Calling method '>' {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:10:47.394755 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.wsgi [None req-e2bd9007-dc8d-45bf-b38b-a03bd9969d54 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 12 04:10:47.395484 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-e2bd9007-dc8d-45bf-b38b-a03bd9969d54 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:10:47.396278 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-e2bd9007-dc8d-45bf-b38b-a03bd9969d54 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059193 Oct 12 04:10:47.396793 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 24/49] 10.222.0.21 () {60 vars in 1193 bytes} [Tue Oct 12 04:10:47 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 04:10:47.406544 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-b22d679f-6a5e-4e51-8ee4-2aa9c5cc0c0b admin admin] Calling method '>' {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:10:47.420250 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-b22d679f-6a5e-4e51-8ee4-2aa9c5cc0c0b admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017283 Oct 12 04:10:47.420829 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 26/50] 10.222.0.21 () {60 vars in 1210 bytes} [Tue Oct 12 04:10:47 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:10:47.430450 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-2f966130-f6f7-419a-bf1f-ebb40a1d09b2 admin admin] Calling method '>' {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:10:47.444178 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-2f966130-f6f7-419a-bf1f-ebb40a1d09b2 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017091 Oct 12 04:10:47.444693 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 25/51] 10.222.0.21 () {60 vars in 1210 bytes} [Tue Oct 12 04:10:47 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:10:47.454249 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-f7ce79be-ea21-4d3b-a21e-30d1ed5a0c2d admin admin] Calling method '>' {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:10:47.459264 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.wsgi [None req-f7ce79be-ea21-4d3b-a21e-30d1ed5a0c2d admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 12 04:10:47.459883 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-f7ce79be-ea21-4d3b-a21e-30d1ed5a0c2d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:10:47.460646 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-f7ce79be-ea21-4d3b-a21e-30d1ed5a0c2d admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009878 Oct 12 04:10:47.461117 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 27/52] 10.222.0.21 () {60 vars in 1193 bytes} [Tue Oct 12 04:10:47 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 12 04:10:48.857075 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-2f966130-f6f7-419a-bf1f-ebb40a1d09b2 admin admin] Calling method '>' {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:10:48.858072 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-2f966130-f6f7-419a-bf1f-ebb40a1d09b2 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 12 04:10:48.858468 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 26/53] 10.222.0.21 () {56 vars in 1074 bytes} [Tue Oct 12 04:10:48 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:10:49.047298 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-c7b8a3a3-80f3-49ee-93f9-bfcdbac77562 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:10:49.136198 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-c7b8a3a3-80f3-49ee-93f9-bfcdbac77562 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.140847 Oct 12 04:10:49.136725 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 28/54] 10.222.0.21 () {64 vars in 1235 bytes} [Tue Oct 12 04:10:48 2021] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:10:50.537578 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-2f966130-f6f7-419a-bf1f-ebb40a1d09b2 admin admin] Calling method '>' {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:10:50.538581 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-2f966130-f6f7-419a-bf1f-ebb40a1d09b2 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Oct 12 04:10:50.539032 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 27/55] 10.222.0.21 () {56 vars in 1074 bytes} [Tue Oct 12 04:10:50 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:10:50.728469 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-07f3d251-4ba7-49e2-9c87-e6f79f752884 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:10:50.804375 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-07f3d251-4ba7-49e2-9c87-e6f79f752884 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.126778 Oct 12 04:10:50.804927 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 29/56] 10.222.0.21 () {64 vars in 1235 bytes} [Tue Oct 12 04:10:50 2021] POST /compute/v2.1/flavors => generated 405 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:10:52.192522 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-2f966130-f6f7-419a-bf1f-ebb40a1d09b2 admin admin] Calling method '>' {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:10:52.193537 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-2f966130-f6f7-419a-bf1f-ebb40a1d09b2 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Oct 12 04:10:52.193925 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 28/57] 10.222.0.21 () {56 vars in 1074 bytes} [Tue Oct 12 04:10:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:10:52.384770 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-b492e874-0a48-459e-80e5-47b53f5b050d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:10:52.473891 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-b492e874-0a48-459e-80e5-47b53f5b050d admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.142863 Oct 12 04:10:52.474369 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 30/58] 10.222.0.21 () {64 vars in 1235 bytes} [Tue Oct 12 04:10:52 2021] POST /compute/v2.1/flavors => generated 407 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:10:53.888797 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-2f966130-f6f7-419a-bf1f-ebb40a1d09b2 admin admin] Calling method '>' {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:10:53.889893 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-2f966130-f6f7-419a-bf1f-ebb40a1d09b2 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Oct 12 04:10:53.890287 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 29/59] 10.222.0.21 () {56 vars in 1074 bytes} [Tue Oct 12 04:10:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:10:54.083509 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-408961a1-db91-4f1c-b767-66ffbbe43b8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:10:54.191878 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-408961a1-db91-4f1c-b767-66ffbbe43b8c admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.158498 Oct 12 04:10:54.192432 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 31/60] 10.222.0.21 () {64 vars in 1235 bytes} [Tue Oct 12 04:10:54 2021] POST /compute/v2.1/flavors => generated 409 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:10:55.616145 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-2f966130-f6f7-419a-bf1f-ebb40a1d09b2 admin admin] Calling method '>' {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:10:55.617142 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-2f966130-f6f7-419a-bf1f-ebb40a1d09b2 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Oct 12 04:10:55.623682 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 30/61] 10.222.0.21 () {56 vars in 1074 bytes} [Tue Oct 12 04:10:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:10:55.809673 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-78617e45-18bb-4b90-84a9-72bf930b6d49 admin admin] Calling method '>' {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:10:55.828953 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-78617e45-18bb-4b90-84a9-72bf930b6d49 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070459 Oct 12 04:10:55.829452 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 32/62] 10.222.0.21 () {60 vars in 1202 bytes} [Tue Oct 12 04:10:55 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:11:42.159645 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-2f966130-f6f7-419a-bf1f-ebb40a1d09b2 admin admin] Calling method '>' {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:11:42.160653 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-2f966130-f6f7-419a-bf1f-ebb40a1d09b2 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Oct 12 04:11:42.161050 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 31/63] 10.222.0.21 () {54 vars in 930 bytes} [Tue Oct 12 04:11:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:11:42.232027 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-ed33132c-b992-40e9-a449-d3284c1471c0 admin admin] Calling method '>' {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:11:42.250599 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-ed33132c-b992-40e9-a449-d3284c1471c0 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.083099 Oct 12 04:11:42.251166 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 33/64] 10.222.0.21 () {60 vars in 1291 bytes} [Tue Oct 12 04:11:42 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:11:42.273333 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-a25c5f77-ec2d-4820-8448-0677039356e4 admin admin] Calling method '>' {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:11:42.281511 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-a25c5f77-ec2d-4820-8448-0677039356e4 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011700 Oct 12 04:11:42.282021 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 32/65] 10.222.0.21 () {60 vars in 1282 bytes} [Tue Oct 12 04:11:42 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:11:42.293297 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-a09ea3f5-7d43-4359-9718-ee48a4d7e122 admin admin] Calling method '>' {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:11:42.300524 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-a09ea3f5-7d43-4359-9718-ee48a4d7e122 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010691 Oct 12 04:11:42.301022 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 34/66] 10.222.0.21 () {60 vars in 1285 bytes} [Tue Oct 12 04:11:42 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:11:42.312599 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-22ae8d8f-378b-49be-a593-ce8d23233901 admin admin] Calling method '>' {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:11:42.319717 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-22ae8d8f-378b-49be-a593-ce8d23233901 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010409 Oct 12 04:11:42.320222 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 33/67] 10.222.0.21 () {60 vars in 1285 bytes} [Tue Oct 12 04:11:42 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:11:42.333329 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-e8a37605-9fce-48b6-ae8d-c94663427465 admin admin] Calling method '>' {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:11:42.343490 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-e8a37605-9fce-48b6-ae8d-c94663427465 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013399 Oct 12 04:11:42.344140 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 35/68] 10.222.0.21 () {60 vars in 1282 bytes} [Tue Oct 12 04:11:42 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:13:33.531150 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-227f3650-17e7-489f-ac24-664fcaa45ef5 tempest-verify_tempest_config-2138091865 tempest-verify_tempest_config-2138091865-project] Calling method '>' {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:13:33.533127 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-227f3650-17e7-489f-ac24-664fcaa45ef5 tempest-verify_tempest_config-2138091865 tempest-verify_tempest_config-2138091865-project] 10.222.0.21 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.104406 Oct 12 04:13:33.533658 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 34/69] 10.222.0.21 () {58 vars in 1133 bytes} [Tue Oct 12 04:13:33 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:14:56.147016 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-e8a37605-9fce-48b6-ae8d-c94663427465 admin admin] Calling method '>' {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:14:56.148010 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-e8a37605-9fce-48b6-ae8d-c94663427465 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 12 04:14:56.148404 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 36/70] 10.222.0.21 () {56 vars in 1074 bytes} [Tue Oct 12 04:14:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:14:56.405490 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-f7a61dcc-9acf-401a-9826-c80ecc927819 admin admin] Calling method '>' {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:14:56.407279 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:14:56.407279 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: warnings.warn(msg) Oct 12 04:14:56.408783 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG oslo_concurrency.lockutils [None req-f7a61dcc-9acf-401a-9826-c80ecc927819 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:14:56.409222 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG oslo_concurrency.lockutils [None req-f7a61dcc-9acf-401a-9826-c80ecc927819 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:14:56.410016 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG oslo_concurrency.lockutils [None req-f7a61dcc-9acf-401a-9826-c80ecc927819 admin admin] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:14:56.410439 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG oslo_concurrency.lockutils [None req-f7a61dcc-9acf-401a-9826-c80ecc927819 admin admin] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:14:56.448634 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-f7a61dcc-9acf-401a-9826-c80ecc927819 admin admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.160087 Oct 12 04:14:56.449214 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 35/71] 10.222.0.21 () {60 vars in 1193 bytes} [Tue Oct 12 04:14:56 2021] GET /compute/v2.1/os-services => generated 791 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:14:57.878869 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-e8a37605-9fce-48b6-ae8d-c94663427465 admin admin] Calling method '>' {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:14:57.879857 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-e8a37605-9fce-48b6-ae8d-c94663427465 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Oct 12 04:14:57.880247 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 37/72] 10.222.0.21 () {56 vars in 1074 bytes} [Tue Oct 12 04:14:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:14:58.080339 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-e2e4d5e8-7caf-42d6-82c9-d3eba19d1916 admin admin] Calling method '>' {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:14:58.081486 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:14:58.081486 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: warnings.warn(msg) Oct 12 04:14:58.083013 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG oslo_concurrency.lockutils [None req-e2e4d5e8-7caf-42d6-82c9-d3eba19d1916 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:14:58.083447 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG oslo_concurrency.lockutils [None req-e2e4d5e8-7caf-42d6-82c9-d3eba19d1916 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:14:58.084226 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG oslo_concurrency.lockutils [None req-e2e4d5e8-7caf-42d6-82c9-d3eba19d1916 admin admin] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:14:58.084777 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG oslo_concurrency.lockutils [None req-e2e4d5e8-7caf-42d6-82c9-d3eba19d1916 admin admin] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:14:58.103458 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-e2e4d5e8-7caf-42d6-82c9-d3eba19d1916 admin admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.073837 Oct 12 04:14:58.104009 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 36/73] 10.222.0.21 () {60 vars in 1193 bytes} [Tue Oct 12 04:14:58 2021] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:15:09.928652 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-e8a37605-9fce-48b6-ae8d-c94663427465 admin admin] Calling method '>' {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:15:09.929646 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-e8a37605-9fce-48b6-ae8d-c94663427465 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Oct 12 04:15:09.930042 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 38/74] 10.222.0.21 () {56 vars in 1074 bytes} [Tue Oct 12 04:15:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:15:10.121454 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-620475a1-94c4-49dd-b101-7274a51552f9 admin admin] Calling method '>' {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:15:10.122604 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:15:10.122604 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: warnings.warn(msg) Oct 12 04:15:10.124155 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG oslo_concurrency.lockutils [None req-620475a1-94c4-49dd-b101-7274a51552f9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:15:10.124593 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG oslo_concurrency.lockutils [None req-620475a1-94c4-49dd-b101-7274a51552f9 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:15:10.125418 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG oslo_concurrency.lockutils [None req-620475a1-94c4-49dd-b101-7274a51552f9 admin admin] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:15:10.125844 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG oslo_concurrency.lockutils [None req-620475a1-94c4-49dd-b101-7274a51552f9 admin admin] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:15:10.149458 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-620475a1-94c4-49dd-b101-7274a51552f9 admin admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078138 Oct 12 04:15:10.149997 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 37/75] 10.222.0.21 () {60 vars in 1193 bytes} [Tue Oct 12 04:15:10 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:15:11.555016 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: DEBUG nova.api.openstack.wsgi [None req-e8a37605-9fce-48b6-ae8d-c94663427465 admin admin] Calling method '>' {{(pid=93917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:15:11.556003 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: INFO nova.api.openstack.requestlog [None req-e8a37605-9fce-48b6-ae8d-c94663427465 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Oct 12 04:15:11.556390 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: [pid: 93917|app: 0|req: 39/76] 10.222.0.21 () {56 vars in 1074 bytes} [Tue Oct 12 04:15:11 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:15:11.750279 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG nova.api.openstack.wsgi [None req-9e1c955f-734d-4b23-a5e5-9ef8af26b647 admin admin] Calling method '>' {{(pid=93918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:15:11.751461 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:15:11.751461 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: warnings.warn(msg) Oct 12 04:15:11.752969 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG oslo_concurrency.lockutils [None req-9e1c955f-734d-4b23-a5e5-9ef8af26b647 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:15:11.753403 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG oslo_concurrency.lockutils [None req-9e1c955f-734d-4b23-a5e5-9ef8af26b647 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:15:11.754190 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG oslo_concurrency.lockutils [None req-9e1c955f-734d-4b23-a5e5-9ef8af26b647 admin admin] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:15:11.754632 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: DEBUG oslo_concurrency.lockutils [None req-9e1c955f-734d-4b23-a5e5-9ef8af26b647 admin admin] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:15:11.776156 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: INFO nova.api.openstack.requestlog [None req-9e1c955f-734d-4b23-a5e5-9ef8af26b647 admin admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077569 Oct 12 04:15:11.776649 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: [pid: 93918|app: 0|req: 38/77] 10.222.0.21 () {60 vars in 1193 bytes} [Tue Oct 12 04:15:11 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:16:07.346244 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: Tue Oct 12 04:16:07 2021 - graceful shutdown triggered... Oct 12 04:16:07.346003 dv-cinder-813067-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 12 04:16:07.347236 dv-cinder-813067-1-iscsi devstack@n-api.service[93917]: Gracefully killing worker 1 (pid: 93917)... Oct 12 04:16:07.347746 dv-cinder-813067-1-iscsi devstack@n-api.service[93918]: Gracefully killing worker 2 (pid: 93918)... Oct 12 04:16:08.346534 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: worker 1 buried after 1 seconds Oct 12 04:16:08.347118 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: worker 2 buried after 1 seconds Oct 12 04:16:08.347118 dv-cinder-813067-1-iscsi devstack@n-api.service[93916]: goodbye to uWSGI. Oct 12 04:16:08.348049 dv-cinder-813067-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 12 04:16:08.348614 dv-cinder-813067-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 12 04:16:08.351369 dv-cinder-813067-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 12 04:16:08.362916 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 12 04:16:08.364929 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 12 04:16:08 2021] *** Oct 12 04:16:08.364929 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 12 04:16:08.364929 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 12 04:16:08.364929 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: nodename: dv-cinder-813067-1-iscsi Oct 12 04:16:08.364929 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: machine: x86_64 Oct 12 04:16:08.364929 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: clock source: unix Oct 12 04:16:08.364929 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: pcre jit disabled Oct 12 04:16:08.364929 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: detected number of CPU cores: 4 Oct 12 04:16:08.364929 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: current working directory: / Oct 12 04:16:08.364929 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: detected binary path: /usr/bin/uwsgi-core Oct 12 04:16:08.364929 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: your processes number limit is 47680 Oct 12 04:16:08.365664 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: your memory page size is 4096 bytes Oct 12 04:16:08.365664 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: detected max file descriptor number: 2048 Oct 12 04:16:08.365664 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: lock engine: pthread robust mutexes Oct 12 04:16:08.365664 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: thunder lock: enabled Oct 12 04:16:08.365664 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 12 04:16:08.365664 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 12 04:16:08.409796 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: Python main interpreter initialized at 0x5558c227c9c0 Oct 12 04:16:08.409796 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: python threads support enabled Oct 12 04:16:08.409796 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: your server socket listen backlog is limited to 100 connections Oct 12 04:16:08.409796 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: your mercy for graceful operations on workers is 90 seconds Oct 12 04:16:08.410222 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: mapped 403077 bytes (393 KB) for 2 cores Oct 12 04:16:08.410222 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: *** Operational MODE: preforking *** Oct 12 04:16:08.410514 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: *** uWSGI is running in multiple interpreter mode *** Oct 12 04:16:08.410514 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: spawned uWSGI master process (pid: 108880) Oct 12 04:16:08.410744 dv-cinder-813067-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 12 04:16:08.411303 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: spawned uWSGI worker 1 (pid: 108897, cores: 1) Oct 12 04:16:08.411852 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: spawned uWSGI worker 2 (pid: 108898, cores: 1) Oct 12 04:16:08.413110 dv-cinder-813067-1-iscsi devstack@n-api.service[108880]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 12 04:16:10.189746 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 04:16:10.189746 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: from cryptography.utils import int_from_bytes Oct 12 04:16:10.190443 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 04:16:10.190443 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: from cryptography.utils import int_from_bytes Oct 12 04:16:10.216719 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 04:16:10.216719 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: from cryptography.utils import int_from_bytes Oct 12 04:16:10.225127 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 04:16:10.225127 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: from cryptography.utils import int_from_bytes Oct 12 04:16:12.740840 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 04:16:12.741401 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 04:16:12.741689 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 04:16:12.741990 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 04:16:12.742177 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 04:16:12.742568 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.742925 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.743246 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.743567 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.743896 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.744205 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.744525 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.744891 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.745164 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.745421 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.745733 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.746052 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813067-1-iscsi {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.746370 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.746694 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.747020 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.747334 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.747634 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.747954 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.748257 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.748753 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.755004 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.755004 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.755004 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.755004 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.755004 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.755004 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.755004 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.755004 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.755682 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.755682 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.755682 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813067-1-iscsi {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.755682 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.755682 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.755682 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.755682 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.755682 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.756183 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.756183 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.756183 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.756183 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.756183 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.756508 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.760352 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.760352 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.760352 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.760352 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.760352 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.760352 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.760352 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.760352 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.760943 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.760943 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.760943 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.760943 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.760943 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.760943 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.760943 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.761390 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.761390 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.761524 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.762022 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.762187 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.762365 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.762932 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.763429 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.763940 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.764431 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.765031 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.765530 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.766075 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.767224 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.767736 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.768363 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.21 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.768685 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.21 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.769007 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.769356 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.769680 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.769991 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.770313 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.770634 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.770972 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.771284 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.771594 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.771914 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.772036 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 04:16:12.772399 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 04:16:12.772479 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.772552 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.772646 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 04:16:12.772780 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.773081 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.773387 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.773647 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 04:16:12.773755 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.773914 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 04:16:12.774051 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.774297 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.774605 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.774933 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.775089 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.775231 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.775448 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.775724 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.775827 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.776034 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.776130 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.776341 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.776446 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.776652 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.776755 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.776956 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.777076 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.777348 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.777684 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.777803 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.777940 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.778077 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.778309 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.778627 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.778770 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.778980 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.779084 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813067-1-iscsi {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.779290 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.779386 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.779599 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.779752 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.779896 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.780046 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.780197 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.780357 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.780507 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.780655 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.780796 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.780951 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.781103 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.781262 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.781404 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.782212 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.782421 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.782575 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.782752 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.782911 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.783054 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.783203 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.783354 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.783525 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.783683 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.783847 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.783995 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.784161 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.784310 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.784566 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.784721 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.784864 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.785006 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.785160 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.785310 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.785460 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.785602 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.785768 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.785921 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813067-1-iscsi {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.786075 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.786218 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.786359 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.786499 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.786653 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.786844 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.786986 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.787229 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.787711 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.787940 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.788096 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.788364 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.788705 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.788852 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.789000 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.789143 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.789304 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.789447 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.789587 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.789734 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.789876 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.790031 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.790179 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.790330 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.790484 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.790688 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.790855 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.791012 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.791162 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.791311 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.791464 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.791605 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.791748 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.791748 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.792038 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.792187 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.792344 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.792487 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.792641 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.792783 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.792935 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.793083 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.793235 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.793484 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.793744 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.793893 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.794053 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.794199 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.794359 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.794502 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.794653 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.794832 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.794976 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.795117 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.795268 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.795268 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.795638 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.795782 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.795933 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.796081 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.796233 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.796388 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.796531 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.796680 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.796822 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.796969 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.797117 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.798364 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.798610 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.798965 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.799123 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.799123 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.799410 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.799566 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.799708 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.799859 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.800002 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.800151 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.800306 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.800448 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.800590 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.800730 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.800872 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.800872 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.801161 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.21 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.801161 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.21 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.801448 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.801591 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.801739 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.801896 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.802051 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.802200 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.802489 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.802645 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.802866 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.803019 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.803169 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.803311 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.803462 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.803603 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.803751 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.803901 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.804043 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.804208 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.804351 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.804492 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.804632 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.804632 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.804909 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.805050 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.805198 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.805198 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.805477 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.805628 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.805769 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.805909 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.806061 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.806211 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.806365 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.806508 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.806656 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.806822 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.806975 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.807135 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.807300 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.807442 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.807584 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.807732 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.807882 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.808456 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.808637 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.808846 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.809178 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.809334 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.809477 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.809626 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.809778 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.809938 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.810082 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.810233 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.810374 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.810522 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.810705 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.810854 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.811007 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.811164 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.811307 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.811456 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.811598 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.811759 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.811916 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.812058 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.812200 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.812349 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.812500 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.812651 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.812806 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.813002 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.813145 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.813294 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.813438 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.813579 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.813737 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.813888 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.814045 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.814196 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.814338 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.814488 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.814639 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.814804 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.814961 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.815103 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.815243 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.815383 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.815539 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.815698 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.815848 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.815990 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.816138 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.816280 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.816433 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.816583 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.816733 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.816874 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.817022 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.817164 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.817314 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.817456 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.817614 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.817765 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.817913 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.817913 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.818595 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.818595 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.819034 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.819361 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.819510 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.819740 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.819885 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.819885 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.820169 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.820326 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.820482 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.820636 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.820780 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.820921 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.821069 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.821069 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.821344 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.821494 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.821646 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.821797 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:16:12.821949 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.822108 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.822263 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.822263 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.822547 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.822719 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.822875 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.823018 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.823167 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.823309 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.823464 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.823615 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.823757 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.823757 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.824374 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.824526 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.824670 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.824810 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.824959 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.825108 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.825108 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.825401 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.825542 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.825691 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.825840 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.825993 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.826142 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.826294 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.826437 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.826586 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.826778 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.826934 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.826934 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.827218 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.827361 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.827501 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.827650 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.827801 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.827943 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.828102 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.828244 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.828855 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.829017 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.829248 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.829585 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.829733 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.829927 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.830070 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.830226 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.830226 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.830496 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.830637 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.830812 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.830956 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.831110 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.831253 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.831401 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.831543 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.831690 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.831831 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.831986 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.832128 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.832270 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.832420 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.832562 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.832562 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.833011 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.833275 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.833439 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.833591 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.833742 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.833892 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.834040 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.834186 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.834337 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.834481 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.834631 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.834811 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.834972 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.835122 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.835264 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.835406 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.835547 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.835697 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.835846 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.835989 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.836129 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.836286 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.836436 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.836587 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.836746 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.837008 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.837179 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.837333 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.837483 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.837626 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.837767 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.837915 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.838057 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.838196 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.838346 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.838931 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.839084 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.839254 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.839466 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.839790 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.839952 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.840103 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.840260 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.840416 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.840558 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.840700 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.840854 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.841004 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.841145 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.841285 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.841438 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.841588 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.841749 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.841972 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.842137 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.842288 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.842437 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.842609 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.842787 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.842932 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.843165 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.843320 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.843469 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.843636 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.843779 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.843921 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.844575 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.844737 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.844889 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.845044 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.845201 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.845350 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.845499 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.845499 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.845789 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.845789 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.846084 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.846084 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.846371 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.846512 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.846722 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.846722 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.847010 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.847153 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.847293 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.847441 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.847591 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.847733 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.847887 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.848037 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.848178 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.848319 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.848467 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.848854 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.849134 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.849290 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.849458 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.849669 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.850004 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.850160 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.850302 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.850461 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.850604 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.850851 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.851004 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.851155 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.851305 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.851447 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.851588 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.851738 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.851879 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.852027 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.852169 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.852309 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.852309 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.852606 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.852755 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.852895 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.853036 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.853192 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.853413 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.853558 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.853701 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.853849 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.853999 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.854140 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.854302 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.854452 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.854593 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.854763 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.854916 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.855066 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.855218 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.855367 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.855516 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.855664 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.855806 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.855947 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.856097 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.856248 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.856390 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.856547 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.856697 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.856844 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.857005 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.857161 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.857324 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.857482 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.857642 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.857805 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.857962 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.858117 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.858284 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.858440 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.858590 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.859030 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.859321 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.859471 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.859621 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.860627 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.860783 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.860939 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.861089 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.861238 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.861399 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.861559 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.861718 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.862136 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.862287 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.862428 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.862580 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.862743 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.862892 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.863043 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.863193 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.863335 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.863571 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.863727 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.863894 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.864037 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.864184 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.864325 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.864480 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.864621 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.864772 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.864915 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.865057 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.865211 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.865353 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.865501 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.865653 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.865802 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.865950 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.866105 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.866247 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.866387 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.866535 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.866711 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.866860 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.867012 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.867161 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.867303 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.867445 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.867603 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.867753 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.867905 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.868053 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.868200 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.868355 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.868512 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.868675 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.868825 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.869322 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.869479 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.869637 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.869793 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.869967 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.870126 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.870275 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.870430 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.870840 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.871008 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.871170 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.871327 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.871476 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.871625 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.871782 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.871930 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.872093 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.872253 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.872401 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.872549 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.872697 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.872858 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.873016 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.873173 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.873321 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.873477 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.874296 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.874453 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.874614 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.874800 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.874963 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.875120 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.875271 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.875696 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.875696 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.876017 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.876169 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.876327 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.876484 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.876635 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.876635 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.876953 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.877111 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.877262 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.877262 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.877547 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.877697 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.877867 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.878023 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.878173 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.878322 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.878471 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.878627 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.878830 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.878983 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.879516 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.879674 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.879825 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.879988 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.880139 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.880288 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.880444 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.880596 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.881033 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.881270 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.881422 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.881592 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.881750 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.881899 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.882048 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.882206 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.882363 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.882520 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.882743 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.882900 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.883049 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.883210 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.883368 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.883526 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.883713 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.883951 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.884114 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.884263 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.884412 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.884560 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.884716 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.884877 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.885060 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.885305 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.885466 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.885622 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.885773 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.885933 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.886090 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.886470 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.886470 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.886822 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.886984 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.887141 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.887305 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.887480 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.887767 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.887883 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.888003 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.888130 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.888261 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.888382 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.888482 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.888568 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.888651 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.888748 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.888843 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.888928 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.889010 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.889100 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.889183 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.889310 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.889699 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.889798 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.889883 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.889966 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.890056 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.890151 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.890151 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.890304 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.890399 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.890489 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.890573 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.890759 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.890866 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.891144 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.891242 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.891354 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.891450 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.891536 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.891631 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.891724 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.891817 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.891920 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.892006 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.892096 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.892186 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.892270 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.892361 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.892458 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.892543 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.892634 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.892634 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.892793 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.892885 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.892977 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.893074 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.893165 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.893256 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.893348 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.893439 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.893522 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.893612 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.893696 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.893787 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.893884 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.893884 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.894065 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.894150 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.894233 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.894327 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.894421 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.894506 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.894590 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.894695 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.894785 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.894885 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.894977 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.895068 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.895160 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.895250 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.895334 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.895494 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.895587 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.895672 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.895756 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.895839 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.895922 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.896014 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.896105 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.896196 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.896298 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.896385 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.896468 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.896559 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.896644 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.896727 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.896727 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.896887 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.896980 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.897071 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.897157 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.897247 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.897331 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.897422 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.897422 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.897595 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.897680 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.897763 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.897854 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.897938 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.898029 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.898114 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.898196 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.898285 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.898451 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.898538 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.898634 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.898872 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.898977 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.899063 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.899153 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.899246 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.899338 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.899422 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.899576 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.899849 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.899941 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.900034 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.900119 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.900210 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.900301 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.900393 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.900478 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.900570 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.900655 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.900744 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.900836 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.900927 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.900927 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.901102 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.901344 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.901443 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.901528 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.901618 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.901777 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.901865 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.901948 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.902100 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.902188 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.902279 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.902371 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.902462 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.902553 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.902715 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.902817 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.903041 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.903148 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.903353 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.903452 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.903683 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.903775 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.903992 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.904090 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.904303 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.904401 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.904613 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.904704 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.904920 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.905019 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.905245 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.905337 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.905558 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.905649 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.905867 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.905958 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.906173 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.906271 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.906477 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.907149 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.907360 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.907521 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.907670 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.907771 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.908196 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.908290 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.908375 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.908467 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.908604 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.908702 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.908917 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.909059 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.909243 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.909346 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.909551 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.909653 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.909876 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.909993 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.910190 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.910297 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.910552 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.910912 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.911125 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.911317 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.911632 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.911784 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.911935 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.912085 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.912235 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.912395 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.912546 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.912695 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.912852 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.913022 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.913253 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.913406 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.913563 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.913714 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.913804 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.913877 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.914053 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.914141 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.914403 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.914501 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.914997 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.915138 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.915241 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.915336 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.915428 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.915519 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.915694 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.915785 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.916026 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.916119 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.916342 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.916440 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.916657 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.916764 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.916974 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.917072 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.917290 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.917381 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.917606 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.917706 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.917922 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.918012 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.918228 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.918396 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.918537 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.918642 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.918898 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.919021 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.919229 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.919339 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.919524 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.919635 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.919959 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.920071 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.920157 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.920239 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.920481 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.920636 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.920923 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.921031 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.921235 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.921325 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.921545 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.921664 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.921868 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.921973 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.922207 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.922971 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.923078 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.923298 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.923409 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.923609 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.923723 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.923925 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.924037 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.924241 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.924396 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.924544 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.924744 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.924889 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.925030 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.925178 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.925319 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.925528 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.925674 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.925862 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.926023 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.926166 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.926306 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.926482 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.926633 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.926816 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.926924 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.927124 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.927226 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.927439 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.927533 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.927753 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.927845 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.928061 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.928153 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.928368 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.928462 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.928674 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.928767 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.928983 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.929075 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.929291 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.929390 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.929606 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.929705 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.929953 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.930049 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.930418 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.930511 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.930775 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.930883 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.931179 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.931329 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.931495 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.931622 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.931808 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.931945 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.932126 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.932273 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.932444 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.932578 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.932759 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.932900 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.933061 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.933204 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.933373 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.933506 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.933680 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.933813 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.934004 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.934140 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.934326 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.934460 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.934637 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.934821 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.934967 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.935110 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.935272 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.935413 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.935596 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.935732 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.935919 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.936057 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.936234 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.936368 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.936554 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.936700 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.936902 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.937028 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.937213 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.937355 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.937530 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.937679 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.937867 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.938012 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.938186 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.938320 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.938499 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.938644 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.938829 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.938975 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.939141 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.939284 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.939431 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.939565 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.939739 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.939875 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.940053 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.940197 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.940341 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.940470 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.940673 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.940834 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.940999 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.941134 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.941336 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.941480 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.941656 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.941796 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.941966 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.942103 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.942278 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.942421 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.942595 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.942784 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.942931 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.943141 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.943284 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.943459 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.943593 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.943791 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.943933 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.944119 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.944254 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.944444 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.944580 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.944751 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.944892 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.945057 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.945192 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.945361 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.945506 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.945666 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.945810 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.945968 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.946102 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.946279 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.946421 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.946587 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.946765 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.946959 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.947100 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.947290 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.947434 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.947601 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.947748 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.947908 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.948049 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.948232 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.948375 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.948544 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.948689 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.948856 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.949079 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.949222 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.949432 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.949580 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.949748 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.949892 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.950055 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.950188 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.950360 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.950497 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.950722 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.950872 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.951035 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.951163 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.951362 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.951514 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.951672 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.951808 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.951974 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.952115 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.952277 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.952423 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.952589 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.952723 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.952890 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.953023 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.953194 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.953328 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.953526 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.953669 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.953833 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.954439 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.954946 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.955101 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.955235 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.955375 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.955375 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.955632 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.955775 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.955908 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.956049 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.956182 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.956321 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.956540 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.956721 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.956864 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.956998 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.957145 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.957286 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.957428 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.957571 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.957715 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.957848 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.957981 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.958114 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.958260 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.958394 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.958527 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.958686 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.958817 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.958961 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.959104 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.959247 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.959388 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.959521 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.959654 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.959793 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.959940 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.960080 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.960222 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.960356 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.960488 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.960632 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.960756 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.960888 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.961028 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.961168 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.961292 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.961456 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.961594 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.961774 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.961911 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.962088 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.962224 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.962779 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.962944 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.963087 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.963221 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.963355 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.963502 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.963629 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.963761 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.963892 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.964033 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.964167 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.964308 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.964452 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.964585 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.964718 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.964896 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.965040 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.965222 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.965367 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.965564 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.965702 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.965876 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.966023 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.966196 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.966332 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.966512 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.966649 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.966845 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.966990 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.967182 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.967317 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.967497 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.967635 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.967802 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.967950 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.968114 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.968248 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.968427 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.968576 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.968724 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.968863 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.969039 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.969686 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.969861 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.970067 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.970212 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.970346 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.970479 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.970623 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.970801 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.970950 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.971099 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.971223 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.971411 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.971550 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.971726 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.971876 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.972017 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.972150 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.972334 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.972477 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.972652 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.972805 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.972972 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.973114 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.973284 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.973421 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.973589 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.973735 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.974010 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.974154 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.974324 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.974460 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.974648 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.974839 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.974975 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.975106 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.975298 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.975443 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.975622 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.975767 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.975947 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.976083 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.976260 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.976403 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.976582 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.976732 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.976892 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.977029 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.977202 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.977338 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.977508 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.977652 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.977811 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.977955 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.978134 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.978279 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.978447 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.978584 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.978776 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.978913 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.979082 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.979266 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.979410 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.979543 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.979715 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.979911 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.980046 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.980259 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.980396 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.980574 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.980711 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.980897 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.981052 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.981221 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.981365 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.981538 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.981674 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.981843 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.981992 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.982166 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.982308 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.982472 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.982607 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.982787 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.982931 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.983107 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.983245 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.983417 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.983554 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.983720 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.983865 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.984027 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.984173 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.984317 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.984450 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.984631 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.984812 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.985476 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.985612 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.985787 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.985929 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.986073 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.986216 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.986403 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.986540 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.986731 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.987140 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.987339 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.987475 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.987616 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.987750 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.987891 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.988037 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.988183 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.988318 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.988450 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.988580 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.988752 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.988902 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.989036 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.989165 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.989344 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.989489 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.989634 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.989785 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.989941 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.990090 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.990223 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.990356 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.990537 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.990705 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.990864 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.991022 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.991158 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.991350 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.991504 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.991697 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.991840 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.992012 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.992155 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.992340 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.992485 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.992653 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.992789 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.992921 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 04:16:12.993064 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.993267 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.993576 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.993884 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.994229 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.994543 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.995144 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.995434 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.995801 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.996192 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.996479 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.996797 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.997107 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.997415 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.997738 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.998051 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.998364 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.998688 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.999076 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.999318 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.999629 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:12.999938 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.000248 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.000588 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.000928 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.001247 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.001566 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.001882 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.002198 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.002508 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.002857 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.003166 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.003474 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.003790 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.004116 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.004429 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.004732 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.005151 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.005464 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.005782 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.006102 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.006411 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.006758 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.007082 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.007393 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.007712 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.008021 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.008348 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.008685 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.009009 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.009333 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.009636 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.009938 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.010871 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.010871 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.011038 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.011288 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.011609 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.011932 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.012243 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.012555 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.012870 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.013205 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.013509 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.013817 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.014146 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.014454 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.014789 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.014929 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_db.sqlalchemy.engines [None req-bba6bbe7-a946-4266-96da-037e894c3aaf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108897) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 04:16:13.015115 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.015409 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.015717 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.016058 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.016386 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.016715 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.017017 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.017338 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.017653 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.017970 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.018283 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.018593 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.018950 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.019260 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.019578 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.019888 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.020197 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.020514 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.020826 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.021148 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.021477 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.021788 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.022112 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.022455 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.022790 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.023137 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.023460 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:16:13.023702 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 04:16:13.045768 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_db.sqlalchemy.engines [None req-ec314576-cdac-42bb-bbfc-8145d7745dba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108898) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 04:16:13.093366 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.context [None req-bba6bbe7-a946-4266-96da-037e894c3aaf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),455ec794-f329-435f-873e-870ca7b342b6(cell1) {{(pid=108897) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 04:16:13.098705 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bba6bbe7-a946-4266-96da-037e894c3aaf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:16:13.100300 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bba6bbe7-a946-4266-96da-037e894c3aaf None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:16:13.101116 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bba6bbe7-a946-4266-96da-037e894c3aaf None None] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:16:13.103075 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bba6bbe7-a946-4266-96da-037e894c3aaf None None] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:16:13.114465 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_db.sqlalchemy.engines [None req-bba6bbe7-a946-4266-96da-037e894c3aaf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108897) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 04:16:13.115428 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_db.sqlalchemy.engines [None req-bba6bbe7-a946-4266-96da-037e894c3aaf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108897) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 04:16:13.123989 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.context [None req-ec314576-cdac-42bb-bbfc-8145d7745dba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),455ec794-f329-435f-873e-870ca7b342b6(cell1) {{(pid=108898) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 04:16:13.128548 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ec314576-cdac-42bb-bbfc-8145d7745dba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:16:13.130132 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ec314576-cdac-42bb-bbfc-8145d7745dba None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:16:13.130964 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ec314576-cdac-42bb-bbfc-8145d7745dba None None] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:16:13.132892 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ec314576-cdac-42bb-bbfc-8145d7745dba None None] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:16:13.143742 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_db.sqlalchemy.engines [None req-ec314576-cdac-42bb-bbfc-8145d7745dba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108898) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 04:16:13.144564 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_db.sqlalchemy.engines [None req-ec314576-cdac-42bb-bbfc-8145d7745dba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108898) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 04:16:13.377352 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_db.sqlalchemy.engines [None req-bba6bbe7-a946-4266-96da-037e894c3aaf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108897) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 04:16:13.402359 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_db.sqlalchemy.engines [None req-ec314576-cdac-42bb-bbfc-8145d7745dba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108898) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 04:16:13.704368 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: WARNING keystonemiddleware.auth_token [None req-bba6bbe7-a946-4266-96da-037e894c3aaf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 04:16:13.711526 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: WARNING keystonemiddleware.auth_token [None req-bba6bbe7-a946-4266-96da-037e894c3aaf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 04:16:13.728369 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: WARNING keystonemiddleware.auth_token [None req-ec314576-cdac-42bb-bbfc-8145d7745dba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 04:16:13.735024 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: WARNING keystonemiddleware.auth_token [None req-ec314576-cdac-42bb-bbfc-8145d7745dba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 04:16:14.064674 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: WARNING keystonemiddleware.auth_token [None req-bba6bbe7-a946-4266-96da-037e894c3aaf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 04:16:14.070144 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: WARNING keystonemiddleware.auth_token [None req-bba6bbe7-a946-4266-96da-037e894c3aaf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 04:16:14.075359 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5558c227c9c0 pid: 108897 (default app) Oct 12 04:16:14.082360 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: WARNING keystonemiddleware.auth_token [None req-ec314576-cdac-42bb-bbfc-8145d7745dba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 04:16:14.087701 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: WARNING keystonemiddleware.auth_token [None req-ec314576-cdac-42bb-bbfc-8145d7745dba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 04:16:14.092774 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5558c227c9c0 pid: 108898 (default app) Oct 12 04:16:49.237931 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ef99fdda-01d8-4e39-9828-2c14a1b91dc5 tempest-VolumesGetTestJSON-1710185953 tempest-VolumesGetTestJSON-1710185953-project] Action: 'create', calling method: .version_select at 0x7f38575da940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-430745371", "metadata": {"Type": "work"}}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:16:50.799116 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ef99fdda-01d8-4e39-9828-2c14a1b91dc5 tempest-VolumesGetTestJSON-1710185953 tempest-VolumesGetTestJSON-1710185953-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.754035 Oct 12 04:16:50.801003 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 1/1] 10.222.0.21 () {60 vars in 1155 bytes} [Tue Oct 12 04:16:48 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 2758 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 12 04:16:51.226936 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-2e226a3f-8deb-4298-bc82-4b833d7aa1df tempest-VolumesGetTestJSON-1710185953 tempest-VolumesGetTestJSON-1710185953-project] Calling method '.version_select at 0x7f3857556ca0>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:16:51.275142 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-6ad437c5-cea8-4eb1-8a08-174d48ca7026 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1620806287", "imageRef": "bf8c5573-3890-45dc-aec8-b1ad89136f80", "flavorRef": "452", "networks": [{"uuid": "ea4a3696-b66f-4246-8a28-be605ab2d343"}]}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:16:51.488090 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.network.neutron [None req-6ad437c5-cea8-4eb1-8a08-174d48ca7026 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] validate_networks() for [('ea4a3696-b66f-4246-8a28-be605ab2d343', None, None, None, None, None)] {{(pid=108897) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 04:16:51.629690 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-2e226a3f-8deb-4298-bc82-4b833d7aa1df tempest-VolumesGetTestJSON-1710185953 tempest-VolumesGetTestJSON-1710185953-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/f9ca5d43-cb47-472a-aa83-a4da7f9f9fa1" status: 200 len: 352 microversion: 2.1 time: 0.820021 Oct 12 04:16:51.630256 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 1/2] 10.222.0.21 () {58 vars in 1244 bytes} [Tue Oct 12 04:16:50 2021] GET /compute/v2.1/os-volumes/f9ca5d43-cb47-472a-aa83-a4da7f9f9fa1 => generated 352 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:16:52.642146 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-e647e4e8-9d47-4087-9bf6-80076a1af23b tempest-VolumesGetTestJSON-1710185953 tempest-VolumesGetTestJSON-1710185953-project] Calling method '.version_select at 0x7f385741fb80>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:16:52.766385 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-e647e4e8-9d47-4087-9bf6-80076a1af23b tempest-VolumesGetTestJSON-1710185953 tempest-VolumesGetTestJSON-1710185953-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/f9ca5d43-cb47-472a-aa83-a4da7f9f9fa1" status: 200 len: 353 microversion: 2.1 time: 0.128351 Oct 12 04:16:52.767256 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 2/3] 10.222.0.21 () {58 vars in 1244 bytes} [Tue Oct 12 04:16:52 2021] GET /compute/v2.1/os-volumes/f9ca5d43-cb47-472a-aa83-a4da7f9f9fa1 => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:16:52.784764 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-00aee7c7-24c5-4b8b-a24e-1125a2134763 tempest-VolumesGetTestJSON-1710185953 tempest-VolumesGetTestJSON-1710185953-project] Calling method '.version_select at 0x7f38573dc430>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:16:52.868550 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-00aee7c7-24c5-4b8b-a24e-1125a2134763 tempest-VolumesGetTestJSON-1710185953 tempest-VolumesGetTestJSON-1710185953-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/f9ca5d43-cb47-472a-aa83-a4da7f9f9fa1" status: 200 len: 353 microversion: 2.1 time: 0.087794 Oct 12 04:16:52.869335 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 3/4] 10.222.0.21 () {58 vars in 1244 bytes} [Tue Oct 12 04:16:52 2021] GET /compute/v2.1/os-volumes/f9ca5d43-cb47-472a-aa83-a4da7f9f9fa1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:16:53.010800 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-6ad437c5-cea8-4eb1-8a08-174d48ca7026 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Flavor limits 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 04:16:53.011365 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-6ad437c5-cea8-4eb1-8a08-174d48ca7026 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Image limits 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 04:16:53.011974 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-6ad437c5-cea8-4eb1-8a08-174d48ca7026 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Flavor pref 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 04:16:53.012377 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-6ad437c5-cea8-4eb1-8a08-174d48ca7026 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Image pref 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 04:16:53.012779 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-6ad437c5-cea8-4eb1-8a08-174d48ca7026 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 04:16:53.030732 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6ad437c5-cea8-4eb1-8a08-174d48ca7026 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:16:53.031221 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6ad437c5-cea8-4eb1-8a08-174d48ca7026 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:16:53.032594 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6ad437c5-cea8-4eb1-8a08-174d48ca7026 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:16:53.033010 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6ad437c5-cea8-4eb1-8a08-174d48ca7026 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:16:53.055582 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-f8983d7e-9231-46ec-acfc-e9e8d7e8b0d5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-303920918", "imageRef": "bf8c5573-3890-45dc-aec8-b1ad89136f80", "flavorRef": "452", "networks": [{"uuid": "382ee370-8814-4057-bb86-a80b3c5a69fd"}]}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:16:53.106089 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-6ad437c5-cea8-4eb1-8a08-174d48ca7026 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Getting quotas for project 7333a6b7535c4821b8eefd5dd71e4e6f. Resources: {'cores', 'instances', 'ram'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:16:53.111722 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-6ad437c5-cea8-4eb1-8a08-174d48ca7026 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Getting quotas for user cd523d965976493ba50e4154e90b123d and project 7333a6b7535c4821b8eefd5dd71e4e6f. Resources: {'cores', 'instances', 'ram'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:16:53.123487 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-6ad437c5-cea8-4eb1-8a08-174d48ca7026 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Going to run 1 instances... {{(pid=108897) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 04:16:53.126826 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-6ad437c5-cea8-4eb1-8a08-174d48ca7026 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf8c5573-3890-45dc-aec8-b1ad89136f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 04:16:53.209786 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.network.neutron [None req-f8983d7e-9231-46ec-acfc-e9e8d7e8b0d5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] validate_networks() for [('382ee370-8814-4057-bb86-a80b3c5a69fd', None, None, None, None, None)] {{(pid=108898) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 04:16:53.327333 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-6ad437c5-cea8-4eb1-8a08-174d48ca7026 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.149282 Oct 12 04:16:53.333725 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 2/5] 10.222.0.21 () {60 vars in 1146 bytes} [Tue Oct 12 04:16:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 2153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 04:16:53.342931 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-a5cc12f6-fd30-4611-8a95-f38e56e3922b tempest-VolumesGetTestJSON-1710185953 tempest-VolumesGetTestJSON-1710185953-project] Calling method '.version_select at 0x7f3856a71310>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:16:53.678984 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-a5cc12f6-fd30-4611-8a95-f38e56e3922b tempest-VolumesGetTestJSON-1710185953 tempest-VolumesGetTestJSON-1710185953-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/f9ca5d43-cb47-472a-aa83-a4da7f9f9fa1" status: 202 len: 0 microversion: 2.1 time: 0.344117 Oct 12 04:16:53.689727 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 3/6] 10.222.0.21 () {58 vars in 1247 bytes} [Tue Oct 12 04:16:53 2021] DELETE /compute/v2.1/os-volumes/f9ca5d43-cb47-472a-aa83-a4da7f9f9fa1 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:16:53.695316 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-6e06be6f-7c96-4af4-9634-fe77e3380aac tempest-VolumesTestJSON-524936383 tempest-VolumesTestJSON-524936383-project] Calling method '.version_select at 0x7f3856a71d30>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:16:53.820716 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-6e06be6f-7c96-4af4-9634-fe77e3380aac tempest-VolumesTestJSON-524936383 tempest-VolumesTestJSON-524936383-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/456ee9a7-67e3-40c6-b61c-43d88c865604" status: 200 len: 350 microversion: 2.1 time: 0.129197 Oct 12 04:16:53.821371 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 4/7] 10.222.0.21 () {58 vars in 1244 bytes} [Tue Oct 12 04:16:53 2021] GET /compute/v2.1/os-volumes/456ee9a7-67e3-40c6-b61c-43d88c865604 => generated 350 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:16:53.825817 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-fbbc627b-f288-4763-8a3c-f5039c3c2f13 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:16:53.826564 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-fbbc627b-f288-4763-8a3c-f5039c3c2f13 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:16:54.253938 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-fbbc627b-f288-4763-8a3c-f5039c3c2f13 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd523d965976493ba50e4154e90b123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7333a6b7535c4821b8eefd5dd71e4e6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:16:54.279692 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-fbbc627b-f288-4763-8a3c-f5039c3c2f13 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 200 len: 1215 microversion: 2.1 time: 0.457166 Oct 12 04:16:54.280728 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 5/8] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:16:53 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 1215 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:16:54.298122 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ea622f7f-cda0-4c30-a208-70861741e8f2 tempest-VolumesGetTestJSON-1710185953 tempest-VolumesGetTestJSON-1710185953-project] Calling method '.version_select at 0x7f3856aa2550>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:16:54.342232 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.wsgi [None req-ea622f7f-cda0-4c30-a208-70861741e8f2 tempest-VolumesGetTestJSON-1710185953 tempest-VolumesGetTestJSON-1710185953-project] HTTP exception thrown: Volume f9ca5d43-cb47-472a-aa83-a4da7f9f9fa1 could not be found. Oct 12 04:16:54.342864 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ea622f7f-cda0-4c30-a208-70861741e8f2 tempest-VolumesGetTestJSON-1710185953 tempest-VolumesGetTestJSON-1710185953-project] Returning 404 to user: Volume f9ca5d43-cb47-472a-aa83-a4da7f9f9fa1 could not be found. {{(pid=108897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:16:54.344246 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ea622f7f-cda0-4c30-a208-70861741e8f2 tempest-VolumesGetTestJSON-1710185953 tempest-VolumesGetTestJSON-1710185953-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/f9ca5d43-cb47-472a-aa83-a4da7f9f9fa1" status: 404 len: 109 microversion: 2.1 time: 0.061527 Oct 12 04:16:54.348292 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 6/9] 10.222.0.21 () {58 vars in 1244 bytes} [Tue Oct 12 04:16:54 2021] GET /compute/v2.1/os-volumes/f9ca5d43-cb47-472a-aa83-a4da7f9f9fa1 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:16:54.720951 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-f8983d7e-9231-46ec-acfc-e9e8d7e8b0d5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Flavor limits 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 04:16:54.721988 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-f8983d7e-9231-46ec-acfc-e9e8d7e8b0d5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Image limits 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 04:16:54.722608 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-f8983d7e-9231-46ec-acfc-e9e8d7e8b0d5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Flavor pref 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 04:16:54.723197 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-f8983d7e-9231-46ec-acfc-e9e8d7e8b0d5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Image pref 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 04:16:54.723773 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-f8983d7e-9231-46ec-acfc-e9e8d7e8b0d5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 04:16:54.751864 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f8983d7e-9231-46ec-acfc-e9e8d7e8b0d5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:16:54.758276 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f8983d7e-9231-46ec-acfc-e9e8d7e8b0d5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:16:54.760678 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f8983d7e-9231-46ec-acfc-e9e8d7e8b0d5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:16:54.761594 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f8983d7e-9231-46ec-acfc-e9e8d7e8b0d5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:16:54.845273 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-f8983d7e-9231-46ec-acfc-e9e8d7e8b0d5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Getting quotas for project 15e19031226d475dbcf3cdfa50550ef4. Resources: {'cores', 'instances', 'ram'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:16:54.857999 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-f8983d7e-9231-46ec-acfc-e9e8d7e8b0d5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Getting quotas for user e56a34c8635a4d3385b0dc3f40f469bd and project 15e19031226d475dbcf3cdfa50550ef4. Resources: {'cores', 'instances', 'ram'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:16:54.934839 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-f8983d7e-9231-46ec-acfc-e9e8d7e8b0d5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Going to run 1 instances... {{(pid=108898) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 04:16:54.934839 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-f8983d7e-9231-46ec-acfc-e9e8d7e8b0d5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf8c5573-3890-45dc-aec8-b1ad89136f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108898) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 04:16:55.253377 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-f8983d7e-9231-46ec-acfc-e9e8d7e8b0d5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.382806 Oct 12 04:16:55.254333 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 4/10] 10.222.0.21 () {60 vars in 1146 bytes} [Tue Oct 12 04:16:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 2384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 04:16:55.264269 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-03d7f5a6-7a36-4c62-b45d-0990672365c8 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:16:55.264864 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-03d7f5a6-7a36-4c62-b45d-0990672365c8 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:16:55.301979 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-45c6739d-d5d1-4f69-87a0-0d90b8777605 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:16:55.303322 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-45c6739d-d5d1-4f69-87a0-0d90b8777605 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:16:55.399995 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-03d7f5a6-7a36-4c62-b45d-0990672365c8 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:16:55.407043 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-03d7f5a6-7a36-4c62-b45d-0990672365c8 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa" status: 200 len: 1217 microversion: 2.1 time: 0.146492 Oct 12 04:16:55.410223 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 7/11] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:16:55 2021] GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa => generated 1217 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:16:55.553490 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-45c6739d-d5d1-4f69-87a0-0d90b8777605 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd523d965976493ba50e4154e90b123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7333a6b7535c4821b8eefd5dd71e4e6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:16:55.579814 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-45c6739d-d5d1-4f69-87a0-0d90b8777605 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 200 len: 1215 microversion: 2.1 time: 0.283311 Oct 12 04:16:55.591900 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 5/12] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:16:55 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 1215 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:16:55.959439 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-d707a332-e95e-439c-802b-79cde8963fe9 tempest-VolumesTestJSON-524936383 tempest-VolumesTestJSON-524936383-project] Calling method '.version_select at 0x7f3856237ee0>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:16:56.074526 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-d707a332-e95e-439c-802b-79cde8963fe9 tempest-VolumesTestJSON-524936383 tempest-VolumesTestJSON-524936383-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/6fa68beb-a446-400b-9082-8ae9b999f16a" status: 200 len: 350 microversion: 2.1 time: 0.116666 Oct 12 04:16:56.075171 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 8/13] 10.222.0.21 () {58 vars in 1244 bytes} [Tue Oct 12 04:16:55 2021] GET /compute/v2.1/os-volumes/6fa68beb-a446-400b-9082-8ae9b999f16a => generated 350 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:16:56.426971 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-256670e3-f2c0-4300-b87b-3d3539767dbd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:16:56.427662 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-256670e3-f2c0-4300-b87b-3d3539767dbd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:16:56.605889 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-d6e9e77d-151a-449c-b489-af2f3e6bb2b3 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:16:56.607773 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-d6e9e77d-151a-449c-b489-af2f3e6bb2b3 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:16:56.620969 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d6e9e77d-151a-449c-b489-af2f3e6bb2b3 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:16:56.622030 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d6e9e77d-151a-449c-b489-af2f3e6bb2b3 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:16:56.623239 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d6e9e77d-151a-449c-b489-af2f3e6bb2b3 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:16:56.624740 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d6e9e77d-151a-449c-b489-af2f3e6bb2b3 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:16:56.716033 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-256670e3-f2c0-4300-b87b-3d3539767dbd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:16:56.724241 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-256670e3-f2c0-4300-b87b-3d3539767dbd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa" status: 200 len: 1217 microversion: 2.1 time: 0.303967 Oct 12 04:16:56.726487 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 6/14] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:16:56 2021] GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa => generated 1217 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:16:56.904799 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-d6e9e77d-151a-449c-b489-af2f3e6bb2b3 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd523d965976493ba50e4154e90b123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7333a6b7535c4821b8eefd5dd71e4e6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:16:56.917106 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-d6e9e77d-151a-449c-b489-af2f3e6bb2b3 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 200 len: 1211 microversion: 2.1 time: 0.315951 Oct 12 04:16:56.918383 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 9/15] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:16:56 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 1211 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:16:57.740948 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-b3634f7b-5edd-4692-a644-3b07063dbcbc tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:16:57.741482 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-b3634f7b-5edd-4692-a644-3b07063dbcbc tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:16:57.874465 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-b3634f7b-5edd-4692-a644-3b07063dbcbc tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:16:57.884783 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-b3634f7b-5edd-4692-a644-3b07063dbcbc tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa" status: 200 len: 1217 microversion: 2.1 time: 0.147419 Oct 12 04:16:57.885630 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 7/16] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:16:57 2021] GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa => generated 1217 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:16:57.935990 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-4987bd7a-ab1a-40ec-9bd8-9151bac6a34f tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:16:57.937121 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-4987bd7a-ab1a-40ec-9bd8-9151bac6a34f tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:16:57.950309 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4987bd7a-ab1a-40ec-9bd8-9151bac6a34f tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:16:57.950996 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4987bd7a-ab1a-40ec-9bd8-9151bac6a34f tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:16:57.951959 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4987bd7a-ab1a-40ec-9bd8-9151bac6a34f tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:16:57.952549 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4987bd7a-ab1a-40ec-9bd8-9151bac6a34f tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:16:58.152861 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d8783408-eabd-4d90-9c6a-1f175c8bba82 tempest-VolumesTestJSON-524936383 tempest-VolumesTestJSON-524936383-project] Calling method '.version_select at 0x7f385622bdc0>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:16:58.258225 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-d8783408-eabd-4d90-9c6a-1f175c8bba82 tempest-VolumesTestJSON-524936383 tempest-VolumesTestJSON-524936383-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/5f1fd9d0-5f30-4da9-bdf2-dfa1307c7543" status: 200 len: 350 microversion: 2.1 time: 0.109165 Oct 12 04:16:58.259170 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 8/17] 10.222.0.21 () {58 vars in 1244 bytes} [Tue Oct 12 04:16:58 2021] GET /compute/v2.1/os-volumes/5f1fd9d0-5f30-4da9-bdf2-dfa1307c7543 => generated 350 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:16:58.272314 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-7783dbf9-466c-44f9-b323-2ea74ed5b0fa tempest-VolumesTestJSON-524936383 tempest-VolumesTestJSON-524936383-project] Calling method '.version_select at 0x7f385622b430>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:16:58.284780 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-4987bd7a-ab1a-40ec-9bd8-9151bac6a34f tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd523d965976493ba50e4154e90b123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7333a6b7535c4821b8eefd5dd71e4e6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:16:58.300637 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-4987bd7a-ab1a-40ec-9bd8-9151bac6a34f tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 200 len: 1267 microversion: 2.1 time: 0.367803 Oct 12 04:16:58.312954 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 10/18] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:16:57 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 1267 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:16:58.425525 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-7783dbf9-466c-44f9-b323-2ea74ed5b0fa tempest-VolumesTestJSON-524936383 tempest-VolumesTestJSON-524936383-project] 10.222.0.21 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.158805 Oct 12 04:16:58.426530 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 9/19] 10.222.0.21 () {58 vars in 1133 bytes} [Tue Oct 12 04:16:58 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:16:58.446142 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-c3692a4a-22e2-4476-aa6b-b0a83b53e177 tempest-VolumesTestJSON-524936383 tempest-VolumesTestJSON-524936383-project] Calling method '.version_select at 0x7f38561ad0d0>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:16:58.686742 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-c3692a4a-22e2-4476-aa6b-b0a83b53e177 tempest-VolumesTestJSON-524936383 tempest-VolumesTestJSON-524936383-project] 10.222.0.21 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.250914 Oct 12 04:16:58.696760 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 11/20] 10.222.0.21 () {58 vars in 1148 bytes} [Tue Oct 12 04:16:58 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:16:58.700711 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-4604d918-d444-4ab0-8551-75007a1c8e24 tempest-VolumesTestJSON-524936383 tempest-VolumesTestJSON-524936383-project] Calling method '.version_select at 0x7f38572e8af0>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:16:58.902898 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-59210812-0d6b-4ac1-8d1b-6d03d10f236e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:16:58.903551 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-59210812-0d6b-4ac1-8d1b-6d03d10f236e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:16:58.922974 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-59210812-0d6b-4ac1-8d1b-6d03d10f236e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:16:58.922974 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-59210812-0d6b-4ac1-8d1b-6d03d10f236e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:16:58.922974 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-59210812-0d6b-4ac1-8d1b-6d03d10f236e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:16:58.922974 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-59210812-0d6b-4ac1-8d1b-6d03d10f236e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:16:58.945975 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-4604d918-d444-4ab0-8551-75007a1c8e24 tempest-VolumesTestJSON-524936383 tempest-VolumesTestJSON-524936383-project] 10.222.0.21 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.248835 Oct 12 04:16:58.946870 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 10/21] 10.222.0.21 () {58 vars in 1133 bytes} [Tue Oct 12 04:16:58 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:16:58.957639 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-40eb9f3f-2433-40be-8c60-5d4edadd1db6 tempest-VolumesTestJSON-524936383 tempest-VolumesTestJSON-524936383-project] Calling method '.version_select at 0x7f38572e88b0>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:16:59.148717 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-40eb9f3f-2433-40be-8c60-5d4edadd1db6 tempest-VolumesTestJSON-524936383 tempest-VolumesTestJSON-524936383-project] 10.222.0.21 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.194192 Oct 12 04:16:59.149834 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 11/22] 10.222.0.21 () {58 vars in 1166 bytes} [Tue Oct 12 04:16:58 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:16:59.161379 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-172d79e2-2936-423d-97c3-78f4c890db3b tempest-VolumesTestJSON-524936383 tempest-VolumesTestJSON-524936383-project] Calling method '.version_select at 0x7f385622b430>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:16:59.265203 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-59210812-0d6b-4ac1-8d1b-6d03d10f236e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:16:59.276835 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-59210812-0d6b-4ac1-8d1b-6d03d10f236e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa" status: 200 len: 1213 microversion: 2.1 time: 0.376260 Oct 12 04:16:59.278746 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 12/23] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:16:58 2021] GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa => generated 1213 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:16:59.323704 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-286b40f7-e2c5-41ce-90a7-900ddcdc7b2b tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:16:59.325202 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-286b40f7-e2c5-41ce-90a7-900ddcdc7b2b tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:16:59.337485 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-286b40f7-e2c5-41ce-90a7-900ddcdc7b2b tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:16:59.339239 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-286b40f7-e2c5-41ce-90a7-900ddcdc7b2b tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:16:59.342233 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-286b40f7-e2c5-41ce-90a7-900ddcdc7b2b tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:16:59.346780 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-286b40f7-e2c5-41ce-90a7-900ddcdc7b2b tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:16:59.392357 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-172d79e2-2936-423d-97c3-78f4c890db3b tempest-VolumesTestJSON-524936383 tempest-VolumesTestJSON-524936383-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.234907 Oct 12 04:16:59.393716 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 12/24] 10.222.0.21 () {58 vars in 1169 bytes} [Tue Oct 12 04:16:59 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:16:59.405886 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-f39e7417-64a1-4218-9cdc-dc9e863e0c6f tempest-VolumesTestJSON-524936383 tempest-VolumesTestJSON-524936383-project] Calling method '.version_select at 0x7f3856237430>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:16:59.616292 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-286b40f7-e2c5-41ce-90a7-900ddcdc7b2b tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd523d965976493ba50e4154e90b123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7333a6b7535c4821b8eefd5dd71e4e6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:16:59.624002 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-286b40f7-e2c5-41ce-90a7-900ddcdc7b2b tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 200 len: 1273 microversion: 2.1 time: 0.307988 Oct 12 04:16:59.625504 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 13/25] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:16:59 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 1273 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:16:59.674318 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-f39e7417-64a1-4218-9cdc-dc9e863e0c6f tempest-VolumesTestJSON-524936383 tempest-VolumesTestJSON-524936383-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.271787 Oct 12 04:16:59.681041 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 13/26] 10.222.0.21 () {58 vars in 1154 bytes} [Tue Oct 12 04:16:59 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:16:59.686149 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-4cb5f240-bf13-4d44-8db1-1d82a9003d1c tempest-VolumesTestJSON-524936383 tempest-VolumesTestJSON-524936383-project] Calling method '.version_select at 0x7f3856aa2e50>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:16:59.917634 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-4cb5f240-bf13-4d44-8db1-1d82a9003d1c tempest-VolumesTestJSON-524936383 tempest-VolumesTestJSON-524936383-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.235071 Oct 12 04:16:59.918897 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 14/27] 10.222.0.21 () {58 vars in 1187 bytes} [Tue Oct 12 04:16:59 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:16:59.930941 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-896b3836-e593-4c44-b8a3-0bbe8fd6bfb9 tempest-VolumesTestJSON-524936383 tempest-VolumesTestJSON-524936383-project] Calling method '.version_select at 0x7f385617a430>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:00.207255 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-896b3836-e593-4c44-b8a3-0bbe8fd6bfb9 tempest-VolumesTestJSON-524936383 tempest-VolumesTestJSON-524936383-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.280409 Oct 12 04:17:00.208367 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 15/28] 10.222.0.21 () {58 vars in 1154 bytes} [Tue Oct 12 04:16:59 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:00.266097 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-f3e4242c-ca0f-433f-9f01-54b9285ca973 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'create', calling method: .version_select at 0x7f385622bb80>, body: {"keypair": {"name": "tempest-keypair-187357208"}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:00.299999 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-4a7b235e-f7fb-46bf-9a44-ceaf1ef97024 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:00.301774 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-4a7b235e-f7fb-46bf-9a44-ceaf1ef97024 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:00.311644 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4a7b235e-f7fb-46bf-9a44-ceaf1ef97024 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:00.314528 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4a7b235e-f7fb-46bf-9a44-ceaf1ef97024 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:00.316392 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4a7b235e-f7fb-46bf-9a44-ceaf1ef97024 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:00.318013 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4a7b235e-f7fb-46bf-9a44-ceaf1ef97024 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:00.401745 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-f3e4242c-ca0f-433f-9f01-54b9285ca973 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Getting quotas for project a99e41211e834d8aaf06b40712cb4893. Resources: {'key_pairs'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:17:00.416900 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-f3e4242c-ca0f-433f-9f01-54b9285ca973 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Getting quotas for user 79ef9f68435646318c114003e8680611 and project a99e41211e834d8aaf06b40712cb4893. Resources: {'key_pairs'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:17:00.555172 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-4a7b235e-f7fb-46bf-9a44-ceaf1ef97024 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:00.565225 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-4a7b235e-f7fb-46bf-9a44-ceaf1ef97024 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa" status: 200 len: 1287 microversion: 2.1 time: 0.274474 Oct 12 04:17:00.567571 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 16/29] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:00 2021] GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa => generated 1287 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:00.641721 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-542ec965-1e7d-401e-a82d-a73d7a640e02 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:00.644108 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-542ec965-1e7d-401e-a82d-a73d7a640e02 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:00.652685 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-542ec965-1e7d-401e-a82d-a73d7a640e02 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:00.655139 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-542ec965-1e7d-401e-a82d-a73d7a640e02 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:00.657037 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-542ec965-1e7d-401e-a82d-a73d7a640e02 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:00.659241 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-542ec965-1e7d-401e-a82d-a73d7a640e02 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:01.091993 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-542ec965-1e7d-401e-a82d-a73d7a640e02 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd523d965976493ba50e4154e90b123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7333a6b7535c4821b8eefd5dd71e4e6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:01.091993 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-542ec965-1e7d-401e-a82d-a73d7a640e02 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 200 len: 1273 microversion: 2.1 time: 0.331357 Oct 12 04:17:01.091993 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 17/30] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:00 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 1273 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:01.584342 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-8914c167-7122-4853-9c64-966e601afa0a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:01.586520 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-8914c167-7122-4853-9c64-966e601afa0a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:01.620749 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8914c167-7122-4853-9c64-966e601afa0a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:01.625818 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8914c167-7122-4853-9c64-966e601afa0a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:01.638148 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8914c167-7122-4853-9c64-966e601afa0a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:01.642751 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8914c167-7122-4853-9c64-966e601afa0a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:01.963165 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-8914c167-7122-4853-9c64-966e601afa0a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:01.974712 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-8914c167-7122-4853-9c64-966e601afa0a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa" status: 200 len: 1275 microversion: 2.1 time: 0.394210 Oct 12 04:17:01.983913 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 18/31] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:01 2021] GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa => generated 1275 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:01.989844 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-9430db6e-a8ab-4c5b-a519-4153ba4cab14 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:01.998745 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-9430db6e-a8ab-4c5b-a519-4153ba4cab14 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:02.006441 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9430db6e-a8ab-4c5b-a519-4153ba4cab14 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:02.007162 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9430db6e-a8ab-4c5b-a519-4153ba4cab14 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:02.008354 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9430db6e-a8ab-4c5b-a519-4153ba4cab14 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:02.008826 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9430db6e-a8ab-4c5b-a519-4153ba4cab14 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:02.029391 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-f3e4242c-ca0f-433f-9f01-54b9285ca973 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Getting quotas for project a99e41211e834d8aaf06b40712cb4893. Resources: {'key_pairs'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:17:02.054644 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-f3e4242c-ca0f-433f-9f01-54b9285ca973 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Getting quotas for user 79ef9f68435646318c114003e8680611 and project a99e41211e834d8aaf06b40712cb4893. Resources: {'key_pairs'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:17:02.096544 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-f3e4242c-ca0f-433f-9f01-54b9285ca973 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 2.264339 Oct 12 04:17:02.101785 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 14/32] 10.222.0.21 () {60 vars in 1157 bytes} [Tue Oct 12 04:16:59 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 2270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:02.273895 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-9430db6e-a8ab-4c5b-a519-4153ba4cab14 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd523d965976493ba50e4154e90b123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7333a6b7535c4821b8eefd5dd71e4e6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:02.286086 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-9430db6e-a8ab-4c5b-a519-4153ba4cab14 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 200 len: 1273 microversion: 2.1 time: 0.300359 Oct 12 04:17:02.288139 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 19/33] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:01 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 1273 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:02.733623 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-edab4ffb-529b-4ea4-bea4-5102cbab65e8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-720820274", "imageRef": "bf8c5573-3890-45dc-aec8-b1ad89136f80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3dd449e6-31a1-474f-a04b-263d450fddb9"}]}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:02.853131 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.network.neutron [None req-edab4ffb-529b-4ea4-bea4-5102cbab65e8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] validate_networks() for [('3dd449e6-31a1-474f-a04b-263d450fddb9', None, None, None, None, None)] {{(pid=108898) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 04:17:03.013625 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-42df641e-ba94-4492-a5d1-d081d7789990 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:03.014970 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-42df641e-ba94-4492-a5d1-d081d7789990 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:03.035848 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-42df641e-ba94-4492-a5d1-d081d7789990 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:03.040091 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-42df641e-ba94-4492-a5d1-d081d7789990 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:03.040091 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-42df641e-ba94-4492-a5d1-d081d7789990 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:03.041068 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-42df641e-ba94-4492-a5d1-d081d7789990 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:03.471202 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-42df641e-ba94-4492-a5d1-d081d7789990 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:03.480251 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-42df641e-ba94-4492-a5d1-d081d7789990 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa" status: 200 len: 1275 microversion: 2.1 time: 0.478153 Oct 12 04:17:03.489307 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 20/34] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:03 2021] GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa => generated 1275 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:03.508812 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-10f03048-3791-4783-8446-4f1230ba37ac tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:03.508812 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-10f03048-3791-4783-8446-4f1230ba37ac tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:03.547758 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-10f03048-3791-4783-8446-4f1230ba37ac tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:03.549040 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-10f03048-3791-4783-8446-4f1230ba37ac tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:03.550117 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-10f03048-3791-4783-8446-4f1230ba37ac tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:03.550919 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-10f03048-3791-4783-8446-4f1230ba37ac tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:04.860129 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-10f03048-3791-4783-8446-4f1230ba37ac tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd523d965976493ba50e4154e90b123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7333a6b7535c4821b8eefd5dd71e4e6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:04.860129 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-10f03048-3791-4783-8446-4f1230ba37ac tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 200 len: 1315 microversion: 2.1 time: 1.276251 Oct 12 04:17:04.860129 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 21/35] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:03 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 1315 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:04.860129 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-310aba41-fe95-49d1-9a73-f77e9850763d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:04.862881 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-310aba41-fe95-49d1-9a73-f77e9850763d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:04.862881 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-310aba41-fe95-49d1-9a73-f77e9850763d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:04.862881 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-310aba41-fe95-49d1-9a73-f77e9850763d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:04.862881 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-310aba41-fe95-49d1-9a73-f77e9850763d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:04.863604 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-310aba41-fe95-49d1-9a73-f77e9850763d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:06.629825 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-310aba41-fe95-49d1-9a73-f77e9850763d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:06.638566 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-310aba41-fe95-49d1-9a73-f77e9850763d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa" status: 200 len: 1317 microversion: 2.1 time: 1.856158 Oct 12 04:17:06.639438 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 22/36] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:04 2021] GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa => generated 1317 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:06.645226 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-9a405918-6aaa-41db-84ae-1439b9db0792 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:06.646248 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-9a405918-6aaa-41db-84ae-1439b9db0792 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:06.655556 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9a405918-6aaa-41db-84ae-1439b9db0792 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:06.656864 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9a405918-6aaa-41db-84ae-1439b9db0792 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:06.658352 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9a405918-6aaa-41db-84ae-1439b9db0792 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:06.659322 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9a405918-6aaa-41db-84ae-1439b9db0792 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:07.848322 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-9a405918-6aaa-41db-84ae-1439b9db0792 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd523d965976493ba50e4154e90b123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7333a6b7535c4821b8eefd5dd71e4e6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:07.856555 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-9a405918-6aaa-41db-84ae-1439b9db0792 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 200 len: 1315 microversion: 2.1 time: 1.215092 Oct 12 04:17:07.857116 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 23/37] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:06 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 1315 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:07.924110 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-edab4ffb-529b-4ea4-bea4-5102cbab65e8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Flavor limits 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 04:17:07.925233 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-edab4ffb-529b-4ea4-bea4-5102cbab65e8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Image limits 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 04:17:07.927602 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-9ced2b3f-d3bf-4bc5-b084-3eece9ab6b68 req-77f70237-30ae-4ce4-b220-254bfdf15245 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "494a399f-a68d-4e9f-8259-fbe4f5b830fa", "tag": "e338ea68-ade7-4184-bc31-d3b708620700"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:07.930260 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:17:07.930260 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:17:07.931631 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-edab4ffb-529b-4ea4-bea4-5102cbab65e8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Flavor pref 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 04:17:07.932371 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-edab4ffb-529b-4ea4-bea4-5102cbab65e8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Image pref 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 04:17:07.932817 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-edab4ffb-529b-4ea4-bea4-5102cbab65e8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 04:17:07.949966 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-edab4ffb-529b-4ea4-bea4-5102cbab65e8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:07.950409 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-edab4ffb-529b-4ea4-bea4-5102cbab65e8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:07.951287 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-edab4ffb-529b-4ea4-bea4-5102cbab65e8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:07.951741 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-edab4ffb-529b-4ea4-bea4-5102cbab65e8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:07.958878 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-9ced2b3f-d3bf-4bc5-b084-3eece9ab6b68 req-77f70237-30ae-4ce4-b220-254bfdf15245 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:07.959385 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-9ced2b3f-d3bf-4bc5-b084-3eece9ab6b68 req-77f70237-30ae-4ce4-b220-254bfdf15245 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:07.987153 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-9ced2b3f-d3bf-4bc5-b084-3eece9ab6b68 req-77f70237-30ae-4ce4-b220-254bfdf15245 service nova] Creating event network-changed:e338ea68-ade7-4184-bc31-d3b708620700 for instance 494a399f-a68d-4e9f-8259-fbe4f5b830fa on hv-cinder-81306 Oct 12 04:17:07.987587 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-9ced2b3f-d3bf-4bc5-b084-3eece9ab6b68 req-77f70237-30ae-4ce4-b220-254bfdf15245 service nova] Acquired lock "compute-rpcapi-router" {{(pid=108897) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 12 04:17:07.990309 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-edab4ffb-529b-4ea4-bea4-5102cbab65e8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Getting quotas for project 9696ef17af304e61842be106e91706e9. Resources: {'cores', 'instances', 'ram'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:17:07.990906 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8ae5f8ce-355b-4bb1-8525-6584b441b87b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:07.994805 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-edab4ffb-529b-4ea4-bea4-5102cbab65e8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Getting quotas for user bf98793849634eb9b6b140f3b44d7371 and project 9696ef17af304e61842be106e91706e9. Resources: {'cores', 'instances', 'ram'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:17:07.994931 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8ae5f8ce-355b-4bb1-8525-6584b441b87b None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:07.995781 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8ae5f8ce-355b-4bb1-8525-6584b441b87b None None] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:07.996213 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8ae5f8ce-355b-4bb1-8525-6584b441b87b None None] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:08.006780 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-edab4ffb-529b-4ea4-bea4-5102cbab65e8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Going to run 1 instances... {{(pid=108898) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 04:17:08.009627 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-edab4ffb-529b-4ea4-bea4-5102cbab65e8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf8c5573-3890-45dc-aec8-b1ad89136f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108898) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 04:17:08.018526 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.compute.rpcapi [None req-8ae5f8ce-355b-4bb1-8525-6584b441b87b None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 12 04:17:08.019484 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8ae5f8ce-355b-4bb1-8525-6584b441b87b None None] Releasing lock "compute-rpcapi-router" {{(pid=108897) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 12 04:17:08.083526 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-8ae5f8ce-355b-4bb1-8525-6584b441b87b None None] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.224827 Oct 12 04:17:08.084625 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 24/38] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:17:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:17:08.090769 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-0e8d59d3-e129-4d26-82d2-c6e0fd1193d1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:08.092066 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-0e8d59d3-e129-4d26-82d2-c6e0fd1193d1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:08.099178 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0e8d59d3-e129-4d26-82d2-c6e0fd1193d1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:08.099939 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0e8d59d3-e129-4d26-82d2-c6e0fd1193d1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:08.100920 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0e8d59d3-e129-4d26-82d2-c6e0fd1193d1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:08.101537 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0e8d59d3-e129-4d26-82d2-c6e0fd1193d1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:08.400696 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-edab4ffb-529b-4ea4-bea4-5102cbab65e8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.001485 Oct 12 04:17:08.406777 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 15/39] 10.222.0.21 () {60 vars in 1146 bytes} [Tue Oct 12 04:17:02 2021] POST /compute/v2.1/servers => generated 383 bytes in 6005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 04:17:08.420824 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-00d94152-32ed-4b98-a428-271b972841a1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:08.423078 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-00d94152-32ed-4b98-a428-271b972841a1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:08.912861 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-00d94152-32ed-4b98-a428-271b972841a1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:08.921233 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-00d94152-32ed-4b98-a428-271b972841a1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1221 microversion: 2.1 time: 0.511115 Oct 12 04:17:08.936359 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 16/40] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:08 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1221 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:08.950992 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-92da26e4-a575-45cd-95d2-54fb44abd4c2 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:08.951661 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-92da26e4-a575-45cd-95d2-54fb44abd4c2 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:08.970441 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-92da26e4-a575-45cd-95d2-54fb44abd4c2 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:08.973613 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-92da26e4-a575-45cd-95d2-54fb44abd4c2 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:08.975248 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-92da26e4-a575-45cd-95d2-54fb44abd4c2 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:08.976625 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-92da26e4-a575-45cd-95d2-54fb44abd4c2 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:09.053376 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-0e8d59d3-e129-4d26-82d2-c6e0fd1193d1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:09.065594 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-0e8d59d3-e129-4d26-82d2-c6e0fd1193d1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa" status: 200 len: 1317 microversion: 2.1 time: 0.976246 Oct 12 04:17:09.092040 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 25/41] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:08 2021] GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa => generated 1317 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:09.429743 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-bda7fecd-f418-4afa-bfb3-706c7569d138 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1619476103", "imageRef": "bf8c5573-3890-45dc-aec8-b1ad89136f80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3dd449e6-31a1-474f-a04b-263d450fddb9"}]}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:09.565936 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.network.neutron [None req-bda7fecd-f418-4afa-bfb3-706c7569d138 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] validate_networks() for [('3dd449e6-31a1-474f-a04b-263d450fddb9', None, None, None, None, None)] {{(pid=108897) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 04:17:10.100200 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-92da26e4-a575-45cd-95d2-54fb44abd4c2 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd523d965976493ba50e4154e90b123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7333a6b7535c4821b8eefd5dd71e4e6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:10.149556 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-92da26e4-a575-45cd-95d2-54fb44abd4c2 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 200 len: 1315 microversion: 2.1 time: 1.210418 Oct 12 04:17:10.158356 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 17/42] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:08 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 1315 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:10.180449 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-6d3f0af5-c387-4fbd-bf08-830dffe6c28f tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:10.186812 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-6d3f0af5-c387-4fbd-bf08-830dffe6c28f tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:10.220916 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6d3f0af5-c387-4fbd-bf08-830dffe6c28f tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:10.224374 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6d3f0af5-c387-4fbd-bf08-830dffe6c28f tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:10.224374 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6d3f0af5-c387-4fbd-bf08-830dffe6c28f tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:10.224374 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6d3f0af5-c387-4fbd-bf08-830dffe6c28f tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:10.861047 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-6d3f0af5-c387-4fbd-bf08-830dffe6c28f tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:10.874122 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-6d3f0af5-c387-4fbd-bf08-830dffe6c28f tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa" status: 200 len: 1317 microversion: 2.1 time: 0.703586 Oct 12 04:17:10.881755 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 18/43] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:10 2021] GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa => generated 1317 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:11.269008 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-1907433d-fe36-43e1-ae20-3f0b21eea550 req-09c40937-85b7-4a8a-9de0-122600fa27c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61a95157-07b2-4d52-a3b5-51e526f99b31", "tag": "45453f45-d5d3-4d04-be84-0088e8ca1bff"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:11.272710 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:17:11.272710 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:17:11.310064 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-1907433d-fe36-43e1-ae20-3f0b21eea550 req-09c40937-85b7-4a8a-9de0-122600fa27c5 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:11.310958 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-1907433d-fe36-43e1-ae20-3f0b21eea550 req-09c40937-85b7-4a8a-9de0-122600fa27c5 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:11.367054 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-1907433d-fe36-43e1-ae20-3f0b21eea550 req-09c40937-85b7-4a8a-9de0-122600fa27c5 service nova] Creating event network-changed:45453f45-d5d3-4d04-be84-0088e8ca1bff for instance 61a95157-07b2-4d52-a3b5-51e526f99b31 on hv-cinder-81306 Oct 12 04:17:11.373310 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-1907433d-fe36-43e1-ae20-3f0b21eea550 req-09c40937-85b7-4a8a-9de0-122600fa27c5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=108898) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 12 04:17:11.380676 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fa8e6092-9b70-40b4-8178-128049d48d65 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:11.384752 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fa8e6092-9b70-40b4-8178-128049d48d65 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:11.386072 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fa8e6092-9b70-40b4-8178-128049d48d65 None None] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:11.386827 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fa8e6092-9b70-40b4-8178-128049d48d65 None None] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:11.401325 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.compute.rpcapi [None req-fa8e6092-9b70-40b4-8178-128049d48d65 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 12 04:17:11.406305 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fa8e6092-9b70-40b4-8178-128049d48d65 None None] Releasing lock "compute-rpcapi-router" {{(pid=108898) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 12 04:17:11.428573 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-fa8e6092-9b70-40b4-8178-128049d48d65 None None] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.544841 Oct 12 04:17:11.430003 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 19/44] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:17:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:17:11.835898 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-bda7fecd-f418-4afa-bfb3-706c7569d138 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Flavor limits 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 04:17:11.836431 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-bda7fecd-f418-4afa-bfb3-706c7569d138 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Image limits 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 04:17:11.836826 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-bda7fecd-f418-4afa-bfb3-706c7569d138 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Flavor pref 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 04:17:11.837309 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-bda7fecd-f418-4afa-bfb3-706c7569d138 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Image pref 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 04:17:11.837723 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-bda7fecd-f418-4afa-bfb3-706c7569d138 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 04:17:11.851098 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bda7fecd-f418-4afa-bfb3-706c7569d138 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:11.851603 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bda7fecd-f418-4afa-bfb3-706c7569d138 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:11.857231 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bda7fecd-f418-4afa-bfb3-706c7569d138 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:11.857989 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bda7fecd-f418-4afa-bfb3-706c7569d138 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:11.893820 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-bda7fecd-f418-4afa-bfb3-706c7569d138 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Getting quotas for project 9696ef17af304e61842be106e91706e9. Resources: {'cores', 'instances', 'ram'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:17:11.899072 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-bda7fecd-f418-4afa-bfb3-706c7569d138 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Getting quotas for user bf98793849634eb9b6b140f3b44d7371 and project 9696ef17af304e61842be106e91706e9. Resources: {'cores', 'instances', 'ram'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:17:11.911359 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-bda7fecd-f418-4afa-bfb3-706c7569d138 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Going to run 1 instances... {{(pid=108897) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 04:17:11.920589 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-bda7fecd-f418-4afa-bfb3-706c7569d138 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf8c5573-3890-45dc-aec8-b1ad89136f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 04:17:11.958033 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-28c81b43-706b-40f4-8cb7-450ffa9522ab tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'create', calling method: .version_select at 0x7f385598a0d0>, body: {"keypair": {"name": "tempest-keypair-193170031"}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:12.016842 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-28c81b43-706b-40f4-8cb7-450ffa9522ab tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Getting quotas for project 94eb0d66d77a44dba68f16a5d05cbe28. Resources: {'key_pairs'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:17:12.035388 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-28c81b43-706b-40f4-8cb7-450ffa9522ab tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Getting quotas for user eacda2627f3a4e20a265952eb29b41d9 and project 94eb0d66d77a44dba68f16a5d05cbe28. Resources: {'key_pairs'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:17:12.126360 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-bda7fecd-f418-4afa-bfb3-706c7569d138 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.711692 Oct 12 04:17:12.136594 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 26/45] 10.222.0.21 () {60 vars in 1146 bytes} [Tue Oct 12 04:17:09 2021] POST /compute/v2.1/servers => generated 383 bytes in 2722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 04:17:12.147831 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-9386f847-a4e6-4daf-b7ce-1c8c428f3d87 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:12.151141 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-9386f847-a4e6-4daf-b7ce-1c8c428f3d87 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:12.165483 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9386f847-a4e6-4daf-b7ce-1c8c428f3d87 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:12.170419 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9386f847-a4e6-4daf-b7ce-1c8c428f3d87 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:12.170419 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9386f847-a4e6-4daf-b7ce-1c8c428f3d87 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:12.170419 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9386f847-a4e6-4daf-b7ce-1c8c428f3d87 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:12.648458 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-28c81b43-706b-40f4-8cb7-450ffa9522ab tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Getting quotas for project 94eb0d66d77a44dba68f16a5d05cbe28. Resources: {'key_pairs'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:17:12.657342 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-28c81b43-706b-40f4-8cb7-450ffa9522ab tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Getting quotas for user eacda2627f3a4e20a265952eb29b41d9 and project 94eb0d66d77a44dba68f16a5d05cbe28. Resources: {'key_pairs'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:17:12.696970 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-28c81b43-706b-40f4-8cb7-450ffa9522ab tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.265285 Oct 12 04:17:12.698533 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 20/46] 10.222.0.21 () {62 vars in 1198 bytes} [Tue Oct 12 04:17:11 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1268 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Oct 12 04:17:12.714362 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-b3ed37fe-1657-4166-82db-8bb144910a25 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:12.715468 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-b3ed37fe-1657-4166-82db-8bb144910a25 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:12.735650 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b3ed37fe-1657-4166-82db-8bb144910a25 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:12.735650 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b3ed37fe-1657-4166-82db-8bb144910a25 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:12.735650 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b3ed37fe-1657-4166-82db-8bb144910a25 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:12.735650 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b3ed37fe-1657-4166-82db-8bb144910a25 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:12.774750 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-9386f847-a4e6-4daf-b7ce-1c8c428f3d87 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd523d965976493ba50e4154e90b123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7333a6b7535c4821b8eefd5dd71e4e6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:12.789878 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-9386f847-a4e6-4daf-b7ce-1c8c428f3d87 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 200 len: 1315 microversion: 2.1 time: 0.647405 Oct 12 04:17:12.790519 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 27/47] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:12 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 1315 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:12.813627 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-5ca6e918-14cd-49c6-ad62-19beb8a81d5c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:12.814348 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-5ca6e918-14cd-49c6-ad62-19beb8a81d5c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:12.973782 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-5ca6e918-14cd-49c6-ad62-19beb8a81d5c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:12.982942 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-5ca6e918-14cd-49c6-ad62-19beb8a81d5c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1222 microversion: 2.1 time: 0.191225 Oct 12 04:17:12.995637 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 28/48] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:12 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1222 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:13.055413 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-b3ed37fe-1657-4166-82db-8bb144910a25 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:13.065549 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-b3ed37fe-1657-4166-82db-8bb144910a25 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa" status: 200 len: 1317 microversion: 2.1 time: 0.364264 Oct 12 04:17:13.066383 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 21/49] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:12 2021] GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:13.571306 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-cda58399-bb9e-46fd-b087-fd9d11077f1e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2078784602", "imageRef": "bf8c5573-3890-45dc-aec8-b1ad89136f80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "47359d39-1ce6-44f7-a02f-d9bf518e6124"}], "security_groups": [{"name": "tempest-securitygroup--52305734"}], "key_name": "tempest-keypair-187357208", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:13.807653 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-5417e7e5-809c-478b-b73d-bc356941e173 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:13.809368 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-5417e7e5-809c-478b-b73d-bc356941e173 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:13.820450 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5417e7e5-809c-478b-b73d-bc356941e173 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:13.840601 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5417e7e5-809c-478b-b73d-bc356941e173 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:13.850544 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5417e7e5-809c-478b-b73d-bc356941e173 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:13.851219 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5417e7e5-809c-478b-b73d-bc356941e173 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:13.966649 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.network.neutron [None req-cda58399-bb9e-46fd-b087-fd9d11077f1e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] validate_networks() for [('47359d39-1ce6-44f7-a02f-d9bf518e6124', None, None, None, None, None)] {{(pid=108897) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 04:17:14.420054 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-5417e7e5-809c-478b-b73d-bc356941e173 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd523d965976493ba50e4154e90b123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7333a6b7535c4821b8eefd5dd71e4e6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:14.420054 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-5417e7e5-809c-478b-b73d-bc356941e173 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 200 len: 1315 microversion: 2.1 time: 0.545796 Oct 12 04:17:14.420054 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 22/50] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:13 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 1315 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:14.420054 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-6e56463f-58cc-44cf-80b0-b7fa7307867a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:14.420813 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-6e56463f-58cc-44cf-80b0-b7fa7307867a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:14.420813 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6e56463f-58cc-44cf-80b0-b7fa7307867a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:14.420813 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6e56463f-58cc-44cf-80b0-b7fa7307867a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:14.420813 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6e56463f-58cc-44cf-80b0-b7fa7307867a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:14.421113 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6e56463f-58cc-44cf-80b0-b7fa7307867a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:14.481479 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-6e56463f-58cc-44cf-80b0-b7fa7307867a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:14.499156 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-6e56463f-58cc-44cf-80b0-b7fa7307867a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1226 microversion: 2.1 time: 0.145909 Oct 12 04:17:14.501344 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 23/51] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:14 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1226 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:14.522058 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-e3b790fb-f306-4fd4-989d-a1fefcb54a91 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:14.527772 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-e3b790fb-f306-4fd4-989d-a1fefcb54a91 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:14.546200 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e3b790fb-f306-4fd4-989d-a1fefcb54a91 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:14.549354 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e3b790fb-f306-4fd4-989d-a1fefcb54a91 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:14.550275 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e3b790fb-f306-4fd4-989d-a1fefcb54a91 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:14.550867 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e3b790fb-f306-4fd4-989d-a1fefcb54a91 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:14.786040 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-cda58399-bb9e-46fd-b087-fd9d11077f1e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Flavor limits 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 04:17:14.787048 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-cda58399-bb9e-46fd-b087-fd9d11077f1e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Image limits 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 04:17:14.787684 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-cda58399-bb9e-46fd-b087-fd9d11077f1e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Flavor pref 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 04:17:14.788239 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-cda58399-bb9e-46fd-b087-fd9d11077f1e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Image pref 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 04:17:14.789747 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-cda58399-bb9e-46fd-b087-fd9d11077f1e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 04:17:14.805729 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-cda58399-bb9e-46fd-b087-fd9d11077f1e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:14.806185 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-cda58399-bb9e-46fd-b087-fd9d11077f1e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:14.819503 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-cda58399-bb9e-46fd-b087-fd9d11077f1e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:14.820000 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-cda58399-bb9e-46fd-b087-fd9d11077f1e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:14.870564 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-cda58399-bb9e-46fd-b087-fd9d11077f1e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Getting quotas for project a99e41211e834d8aaf06b40712cb4893. Resources: {'cores', 'instances', 'ram'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:17:14.877424 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-cda58399-bb9e-46fd-b087-fd9d11077f1e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Getting quotas for user 79ef9f68435646318c114003e8680611 and project a99e41211e834d8aaf06b40712cb4893. Resources: {'cores', 'instances', 'ram'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:17:14.910636 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-cda58399-bb9e-46fd-b087-fd9d11077f1e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Going to run 1 instances... {{(pid=108897) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 04:17:14.923516 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-cda58399-bb9e-46fd-b087-fd9d11077f1e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf8c5573-3890-45dc-aec8-b1ad89136f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 04:17:14.931308 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-e3b790fb-f306-4fd4-989d-a1fefcb54a91 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:14.951649 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-e3b790fb-f306-4fd4-989d-a1fefcb54a91 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa" status: 200 len: 1317 microversion: 2.1 time: 0.440028 Oct 12 04:17:14.953940 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 24/52] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:14 2021] GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa => generated 1317 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:15.179840 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-cda58399-bb9e-46fd-b087-fd9d11077f1e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.613854 Oct 12 04:17:15.181235 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 29/53] 10.222.0.21 () {60 vars in 1146 bytes} [Tue Oct 12 04:17:13 2021] POST /compute/v2.1/servers => generated 400 bytes in 1616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 04:17:15.245002 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-80d2e6df-21d1-4099-8264-261e13cf1dca tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:15.245876 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-80d2e6df-21d1-4099-8264-261e13cf1dca tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:15.339181 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-80d2e6df-21d1-4099-8264-261e13cf1dca tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:15.347142 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-80d2e6df-21d1-4099-8264-261e13cf1dca tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1237 microversion: 2.1 time: 0.105214 Oct 12 04:17:15.348233 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 25/54] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:15 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1237 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:15.454070 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-0f699845-c921-4321-8a0f-cefa08c56f24 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:15.454860 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-0f699845-c921-4321-8a0f-cefa08c56f24 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:15.464546 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0f699845-c921-4321-8a0f-cefa08c56f24 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:15.469958 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0f699845-c921-4321-8a0f-cefa08c56f24 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:15.469958 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0f699845-c921-4321-8a0f-cefa08c56f24 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:15.469958 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0f699845-c921-4321-8a0f-cefa08c56f24 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:15.520319 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-f606c93e-d1ee-4021-ae50-777500488dd3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:15.520319 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-f606c93e-d1ee-4021-ae50-777500488dd3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:15.524391 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f606c93e-d1ee-4021-ae50-777500488dd3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:15.524837 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f606c93e-d1ee-4021-ae50-777500488dd3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:15.534067 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f606c93e-d1ee-4021-ae50-777500488dd3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:15.534772 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f606c93e-d1ee-4021-ae50-777500488dd3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:15.633036 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-f606c93e-d1ee-4021-ae50-777500488dd3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:15.641868 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-f606c93e-d1ee-4021-ae50-777500488dd3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1226 microversion: 2.1 time: 0.128569 Oct 12 04:17:15.651346 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 26/55] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:15 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1226 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:15.693482 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-0f699845-c921-4321-8a0f-cefa08c56f24 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd523d965976493ba50e4154e90b123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7333a6b7535c4821b8eefd5dd71e4e6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:15.700648 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-0f699845-c921-4321-8a0f-cefa08c56f24 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 200 len: 1315 microversion: 2.1 time: 0.250651 Oct 12 04:17:15.701412 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 30/56] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:15 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:15.968591 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-364e5ab4-b0f3-4671-b18d-9cdf71dfbc63 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:15.969229 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-364e5ab4-b0f3-4671-b18d-9cdf71dfbc63 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:15.975124 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-364e5ab4-b0f3-4671-b18d-9cdf71dfbc63 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:15.975588 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-364e5ab4-b0f3-4671-b18d-9cdf71dfbc63 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:15.976496 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-364e5ab4-b0f3-4671-b18d-9cdf71dfbc63 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:15.976933 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-364e5ab4-b0f3-4671-b18d-9cdf71dfbc63 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:16.252304 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-364e5ab4-b0f3-4671-b18d-9cdf71dfbc63 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:16.261934 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-364e5ab4-b0f3-4671-b18d-9cdf71dfbc63 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa" status: 200 len: 1317 microversion: 2.1 time: 0.296916 Oct 12 04:17:16.270738 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 27/57] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:15 2021] GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:16.367965 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-9d21d0d8-2599-474c-af1b-dc3793ba22c2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:16.368587 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-9d21d0d8-2599-474c-af1b-dc3793ba22c2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:16.379952 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9d21d0d8-2599-474c-af1b-dc3793ba22c2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:16.380661 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9d21d0d8-2599-474c-af1b-dc3793ba22c2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:16.382537 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9d21d0d8-2599-474c-af1b-dc3793ba22c2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:16.383223 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9d21d0d8-2599-474c-af1b-dc3793ba22c2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:16.514420 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-9d21d0d8-2599-474c-af1b-dc3793ba22c2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:16.528106 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-9d21d0d8-2599-474c-af1b-dc3793ba22c2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1241 microversion: 2.1 time: 0.163511 Oct 12 04:17:16.528738 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 31/58] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:16 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1241 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:16.660240 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-842d7abd-a673-444a-b4f5-e2d9366559f1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:16.661731 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-842d7abd-a673-444a-b4f5-e2d9366559f1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:16.690505 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-842d7abd-a673-444a-b4f5-e2d9366559f1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:16.691253 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-842d7abd-a673-444a-b4f5-e2d9366559f1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:16.692211 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-842d7abd-a673-444a-b4f5-e2d9366559f1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:16.692799 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-842d7abd-a673-444a-b4f5-e2d9366559f1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:16.717381 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-9e7e798e-9f4c-487a-95a4-40923cacf2c8 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:16.717997 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-9e7e798e-9f4c-487a-95a4-40923cacf2c8 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:16.730317 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9e7e798e-9f4c-487a-95a4-40923cacf2c8 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:16.733646 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9e7e798e-9f4c-487a-95a4-40923cacf2c8 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:16.733646 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9e7e798e-9f4c-487a-95a4-40923cacf2c8 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:16.733646 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9e7e798e-9f4c-487a-95a4-40923cacf2c8 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:16.878085 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-842d7abd-a673-444a-b4f5-e2d9366559f1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:16.891450 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-842d7abd-a673-444a-b4f5-e2d9366559f1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1274 microversion: 2.1 time: 0.236012 Oct 12 04:17:16.894602 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 28/59] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:16 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1274 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:17.141317 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-9e7e798e-9f4c-487a-95a4-40923cacf2c8 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd523d965976493ba50e4154e90b123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7333a6b7535c4821b8eefd5dd71e4e6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:17.151008 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-9e7e798e-9f4c-487a-95a4-40923cacf2c8 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 200 len: 1315 microversion: 2.1 time: 0.437146 Oct 12 04:17:17.152496 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 32/60] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:16 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:17.284786 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-c6968b13-df75-434d-9886-d5b2718c2ce2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:17.285544 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-c6968b13-df75-434d-9886-d5b2718c2ce2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:17.292583 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c6968b13-df75-434d-9886-d5b2718c2ce2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:17.293062 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c6968b13-df75-434d-9886-d5b2718c2ce2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:17.293924 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c6968b13-df75-434d-9886-d5b2718c2ce2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:17.294433 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c6968b13-df75-434d-9886-d5b2718c2ce2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:17.483358 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c6968b13-df75-434d-9886-d5b2718c2ce2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:17.499059 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-c6968b13-df75-434d-9886-d5b2718c2ce2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa" status: 200 len: 1317 microversion: 2.1 time: 0.218973 Oct 12 04:17:17.500494 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 29/61] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:17 2021] GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:17.555409 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-07104406-86e9-4566-acc3-c316ad128771 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:17.556848 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-07104406-86e9-4566-acc3-c316ad128771 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:17.565565 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-07104406-86e9-4566-acc3-c316ad128771 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:17.568046 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-07104406-86e9-4566-acc3-c316ad128771 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:17.568046 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-07104406-86e9-4566-acc3-c316ad128771 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:17.568046 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-07104406-86e9-4566-acc3-c316ad128771 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:17.634442 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-07104406-86e9-4566-acc3-c316ad128771 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:17.648243 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-07104406-86e9-4566-acc3-c316ad128771 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1289 microversion: 2.1 time: 0.101869 Oct 12 04:17:17.649325 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-da44f38b-d6a8-4a71-9c50-af2f770c7342 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1281819174", "imageRef": "bf8c5573-3890-45dc-aec8-b1ad89136f80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7c7c1cf8-2399-44c9-829e-9a108f01a5bc"}], "security_groups": [{"name": "tempest-securitygroup--954060129"}], "key_name": "tempest-keypair-193170031", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:17.655390 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 33/62] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:17 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1289 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:17.795267 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.network.neutron [None req-da44f38b-d6a8-4a71-9c50-af2f770c7342 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] validate_networks() for [('7c7c1cf8-2399-44c9-829e-9a108f01a5bc', None, None, None, None, None)] {{(pid=108898) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 04:17:17.909627 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-5f127198-180e-4493-865c-f6e2a3345527 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:17.911659 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-5f127198-180e-4493-865c-f6e2a3345527 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:17.939086 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5f127198-180e-4493-865c-f6e2a3345527 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:17.945596 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5f127198-180e-4493-865c-f6e2a3345527 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:17.947660 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5f127198-180e-4493-865c-f6e2a3345527 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:17.953979 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5f127198-180e-4493-865c-f6e2a3345527 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:18.080343 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-5f127198-180e-4493-865c-f6e2a3345527 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:18.088987 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-5f127198-180e-4493-865c-f6e2a3345527 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1280 microversion: 2.1 time: 0.183915 Oct 12 04:17:18.089849 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 34/63] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:17 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1280 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:18.168253 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ead8f09b-b076-423e-be9f-d4b184f4fb58 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:18.169194 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ead8f09b-b076-423e-be9f-d4b184f4fb58 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:18.180668 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ead8f09b-b076-423e-be9f-d4b184f4fb58 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:18.184091 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ead8f09b-b076-423e-be9f-d4b184f4fb58 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:18.191038 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ead8f09b-b076-423e-be9f-d4b184f4fb58 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:18.192092 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ead8f09b-b076-423e-be9f-d4b184f4fb58 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:18.855465 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-ead8f09b-b076-423e-be9f-d4b184f4fb58 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd523d965976493ba50e4154e90b123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7333a6b7535c4821b8eefd5dd71e4e6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:18.865218 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ead8f09b-b076-423e-be9f-d4b184f4fb58 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 200 len: 1315 microversion: 2.1 time: 0.698793 Oct 12 04:17:18.866000 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 35/64] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:18 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 1315 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:18.881136 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-3edc5587-0264-4cae-947b-aeb6418f11b8 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:18.882767 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-3edc5587-0264-4cae-947b-aeb6418f11b8 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:18.906712 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3edc5587-0264-4cae-947b-aeb6418f11b8 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:18.911306 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3edc5587-0264-4cae-947b-aeb6418f11b8 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:18.911306 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3edc5587-0264-4cae-947b-aeb6418f11b8 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:18.911306 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3edc5587-0264-4cae-947b-aeb6418f11b8 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:19.177488 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-da44f38b-d6a8-4a71-9c50-af2f770c7342 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Flavor limits 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 04:17:19.178540 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-da44f38b-d6a8-4a71-9c50-af2f770c7342 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Image limits 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 04:17:19.179266 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-da44f38b-d6a8-4a71-9c50-af2f770c7342 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Flavor pref 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 04:17:19.179864 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-da44f38b-d6a8-4a71-9c50-af2f770c7342 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Image pref 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 04:17:19.182733 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-da44f38b-d6a8-4a71-9c50-af2f770c7342 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 04:17:19.196999 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-da44f38b-d6a8-4a71-9c50-af2f770c7342 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:19.197646 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-da44f38b-d6a8-4a71-9c50-af2f770c7342 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:19.213959 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-da44f38b-d6a8-4a71-9c50-af2f770c7342 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:19.214415 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-da44f38b-d6a8-4a71-9c50-af2f770c7342 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:19.285681 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-da44f38b-d6a8-4a71-9c50-af2f770c7342 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Getting quotas for project 94eb0d66d77a44dba68f16a5d05cbe28. Resources: {'cores', 'instances', 'ram'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:17:19.298576 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-da44f38b-d6a8-4a71-9c50-af2f770c7342 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Getting quotas for user eacda2627f3a4e20a265952eb29b41d9 and project 94eb0d66d77a44dba68f16a5d05cbe28. Resources: {'cores', 'instances', 'ram'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:17:19.317672 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-da44f38b-d6a8-4a71-9c50-af2f770c7342 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Going to run 1 instances... {{(pid=108898) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 04:17:19.320900 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-da44f38b-d6a8-4a71-9c50-af2f770c7342 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf8c5573-3890-45dc-aec8-b1ad89136f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108898) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 04:17:19.348308 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-3edc5587-0264-4cae-947b-aeb6418f11b8 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:19.358064 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-3edc5587-0264-4cae-947b-aeb6418f11b8 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa" status: 200 len: 1317 microversion: 2.1 time: 0.481045 Oct 12 04:17:19.358703 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 36/65] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:18 2021] GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa => generated 1317 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:19.365724 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-d1ad73c1-bb3a-4690-8c3f-dbfd94dd08dc tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:19.372741 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-d1ad73c1-bb3a-4690-8c3f-dbfd94dd08dc tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:19.385591 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d1ad73c1-bb3a-4690-8c3f-dbfd94dd08dc tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:19.386263 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d1ad73c1-bb3a-4690-8c3f-dbfd94dd08dc tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:19.389173 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d1ad73c1-bb3a-4690-8c3f-dbfd94dd08dc tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:19.389840 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d1ad73c1-bb3a-4690-8c3f-dbfd94dd08dc tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:19.496182 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-da44f38b-d6a8-4a71-9c50-af2f770c7342 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.852657 Oct 12 04:17:19.498787 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 30/66] 10.222.0.21 () {62 vars in 1187 bytes} [Tue Oct 12 04:17:17 2021] POST /compute/v2.1/servers => generated 401 bytes in 1854 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 04:17:19.512083 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-3f4e0ac2-7320-4e30-9ebb-944151389497 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:19.512757 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-3f4e0ac2-7320-4e30-9ebb-944151389497 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:19.527980 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3f4e0ac2-7320-4e30-9ebb-944151389497 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:19.529665 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3f4e0ac2-7320-4e30-9ebb-944151389497 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:19.531679 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3f4e0ac2-7320-4e30-9ebb-944151389497 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:19.532906 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3f4e0ac2-7320-4e30-9ebb-944151389497 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:19.591085 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-d1ad73c1-bb3a-4690-8c3f-dbfd94dd08dc tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:19.601128 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-d1ad73c1-bb3a-4690-8c3f-dbfd94dd08dc tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1295 microversion: 2.1 time: 0.238782 Oct 12 04:17:19.602357 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 37/67] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:19 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1295 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:19.615421 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-2f68991f-18cb-4716-bcd3-62d6e561b09c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:19.620190 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-2f68991f-18cb-4716-bcd3-62d6e561b09c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:19.813071 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-2f68991f-18cb-4716-bcd3-62d6e561b09c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:19.821026 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-2f68991f-18cb-4716-bcd3-62d6e561b09c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:19.827238 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-2f68991f-18cb-4716-bcd3-62d6e561b09c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:19.828486 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-2f68991f-18cb-4716-bcd3-62d6e561b09c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1281 microversion: 2.20 time: 0.224910 Oct 12 04:17:19.829538 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 38/68] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:17:19 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1281 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:17:19.883299 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-cbef54e2-3005-4f29-8b88-bc3a5a7efc6a tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:19.883899 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-cbef54e2-3005-4f29-8b88-bc3a5a7efc6a tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:19.894500 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-cbef54e2-3005-4f29-8b88-bc3a5a7efc6a tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:19.895077 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-cbef54e2-3005-4f29-8b88-bc3a5a7efc6a tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:19.896015 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-cbef54e2-3005-4f29-8b88-bc3a5a7efc6a tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:19.914812 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-cbef54e2-3005-4f29-8b88-bc3a5a7efc6a tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:20.011111 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-3f4e0ac2-7320-4e30-9ebb-944151389497 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:20.023687 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-3f4e0ac2-7320-4e30-9ebb-944151389497 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1322 microversion: 2.1 time: 0.525121 Oct 12 04:17:20.039124 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 31/69] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:19 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1322 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:20.154630 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-cbef54e2-3005-4f29-8b88-bc3a5a7efc6a tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd523d965976493ba50e4154e90b123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7333a6b7535c4821b8eefd5dd71e4e6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:20.169439 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-cbef54e2-3005-4f29-8b88-bc3a5a7efc6a tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 200 len: 1315 microversion: 2.1 time: 0.290906 Oct 12 04:17:20.185820 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 39/70] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:19 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:20.378873 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-e657af2f-7983-495b-8ea2-a4df71f353a4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:20.381596 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-e657af2f-7983-495b-8ea2-a4df71f353a4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:20.389666 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e657af2f-7983-495b-8ea2-a4df71f353a4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:20.391001 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e657af2f-7983-495b-8ea2-a4df71f353a4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:20.392090 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e657af2f-7983-495b-8ea2-a4df71f353a4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:20.392690 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e657af2f-7983-495b-8ea2-a4df71f353a4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:20.401297 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-75beff5b-2c15-43c2-89fa-46ccc6e223fa req-f182ef61-e24c-411d-acec-eca842fdc341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d927fdb5-40b1-4279-9f0c-7006831e05d2", "tag": "820be35b-a456-4989-96da-b067b6759731"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:20.403166 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:17:20.403166 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:17:20.418715 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-75beff5b-2c15-43c2-89fa-46ccc6e223fa req-f182ef61-e24c-411d-acec-eca842fdc341 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:20.419398 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-75beff5b-2c15-43c2-89fa-46ccc6e223fa req-f182ef61-e24c-411d-acec-eca842fdc341 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:20.442791 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-75beff5b-2c15-43c2-89fa-46ccc6e223fa req-f182ef61-e24c-411d-acec-eca842fdc341 service nova] Creating event network-changed:820be35b-a456-4989-96da-b067b6759731 for instance d927fdb5-40b1-4279-9f0c-7006831e05d2 on hv-cinder-81306 Oct 12 04:17:20.486100 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-75beff5b-2c15-43c2-89fa-46ccc6e223fa req-f182ef61-e24c-411d-acec-eca842fdc341 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088320 Oct 12 04:17:20.490266 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 40/71] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:17:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:17:20.651884 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-daa09b68-9445-4819-bf3d-4291049223ac tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:20.651884 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-daa09b68-9445-4819-bf3d-4291049223ac tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:20.680965 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-daa09b68-9445-4819-bf3d-4291049223ac tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:20.681690 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-daa09b68-9445-4819-bf3d-4291049223ac tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:20.684257 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-daa09b68-9445-4819-bf3d-4291049223ac tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:20.684823 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-daa09b68-9445-4819-bf3d-4291049223ac tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:20.723602 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-e657af2f-7983-495b-8ea2-a4df71f353a4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:20.733204 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-e657af2f-7983-495b-8ea2-a4df71f353a4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa" status: 200 len: 1317 microversion: 2.1 time: 0.358464 Oct 12 04:17:20.733819 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 32/72] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:20 2021] GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa => generated 1317 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:20.846512 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-766ebd2d-ec29-49a9-a67f-d9604f8de8b2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:20.847351 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-766ebd2d-ec29-49a9-a67f-d9604f8de8b2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:20.929825 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-766ebd2d-ec29-49a9-a67f-d9604f8de8b2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:20.947118 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-766ebd2d-ec29-49a9-a67f-d9604f8de8b2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:20.954746 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-766ebd2d-ec29-49a9-a67f-d9604f8de8b2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:20.956417 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-766ebd2d-ec29-49a9-a67f-d9604f8de8b2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1281 microversion: 2.20 time: 0.113811 Oct 12 04:17:20.957822 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 33/73] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:17:20 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1281 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:17:21.041264 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-f31ab14b-2f4e-41d8-a9cf-57c8136b51de tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:21.041996 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-f31ab14b-2f4e-41d8-a9cf-57c8136b51de tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:21.061171 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f31ab14b-2f4e-41d8-a9cf-57c8136b51de tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:21.066519 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f31ab14b-2f4e-41d8-a9cf-57c8136b51de tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:21.068007 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f31ab14b-2f4e-41d8-a9cf-57c8136b51de tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:21.068460 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f31ab14b-2f4e-41d8-a9cf-57c8136b51de tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:21.356379 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-daa09b68-9445-4819-bf3d-4291049223ac tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:21.364010 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-daa09b68-9445-4819-bf3d-4291049223ac tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1361 microversion: 2.1 time: 0.747377 Oct 12 04:17:21.377601 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 41/74] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:20 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1361 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:21.386187 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-7f76278b-dfe8-446c-a1a6-f215273a32bc tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:21.392326 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-7f76278b-dfe8-446c-a1a6-f215273a32bc tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:21.398963 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7f76278b-dfe8-446c-a1a6-f215273a32bc tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:21.399703 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7f76278b-dfe8-446c-a1a6-f215273a32bc tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:21.400695 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7f76278b-dfe8-446c-a1a6-f215273a32bc tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:21.401348 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7f76278b-dfe8-446c-a1a6-f215273a32bc tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:21.556578 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-f31ab14b-2f4e-41d8-a9cf-57c8136b51de tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:21.567860 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-f31ab14b-2f4e-41d8-a9cf-57c8136b51de tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1322 microversion: 2.1 time: 0.529868 Oct 12 04:17:21.580196 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 34/75] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:21 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1322 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:21.631344 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-7f76278b-dfe8-446c-a1a6-f215273a32bc tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd523d965976493ba50e4154e90b123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7333a6b7535c4821b8eefd5dd71e4e6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:21.639451 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-7f76278b-dfe8-446c-a1a6-f215273a32bc tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 200 len: 1315 microversion: 2.1 time: 0.259399 Oct 12 04:17:21.640851 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 42/76] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:21 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:21.696425 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-891b4828-6aa4-4ce1-b94e-1b195661f60a req-0b49fe58-10eb-4b7a-8f4f-452744dde2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbee8a27-52f2-42c0-8cb5-bfade5bfb587", "tag": "8580464d-5ebb-48ed-ba90-238466c4d35b"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:21.698206 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:17:21.698206 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:17:21.707702 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-891b4828-6aa4-4ce1-b94e-1b195661f60a req-0b49fe58-10eb-4b7a-8f4f-452744dde2e5 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:21.712782 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-891b4828-6aa4-4ce1-b94e-1b195661f60a req-0b49fe58-10eb-4b7a-8f4f-452744dde2e5 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:21.730539 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-891b4828-6aa4-4ce1-b94e-1b195661f60a req-0b49fe58-10eb-4b7a-8f4f-452744dde2e5 service nova] Creating event network-changed:8580464d-5ebb-48ed-ba90-238466c4d35b for instance bbee8a27-52f2-42c0-8cb5-bfade5bfb587 on hv-cinder-81306 Oct 12 04:17:21.745757 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-891b4828-6aa4-4ce1-b94e-1b195661f60a req-0b49fe58-10eb-4b7a-8f4f-452744dde2e5 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054212 Oct 12 04:17:21.749133 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 35/77] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:17:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:17:21.764818 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-72e4221d-e328-4134-a3e1-bbad82ec7243 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:21.765964 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-72e4221d-e328-4134-a3e1-bbad82ec7243 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:21.775018 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-72e4221d-e328-4134-a3e1-bbad82ec7243 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:21.780978 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-72e4221d-e328-4134-a3e1-bbad82ec7243 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:21.780978 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-72e4221d-e328-4134-a3e1-bbad82ec7243 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:21.781743 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-72e4221d-e328-4134-a3e1-bbad82ec7243 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:21.980131 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-0f619fe3-de8f-4a2b-b84c-07872f349134 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:21.980131 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-0f619fe3-de8f-4a2b-b84c-07872f349134 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:21.986895 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0f619fe3-de8f-4a2b-b84c-07872f349134 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:21.987761 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0f619fe3-de8f-4a2b-b84c-07872f349134 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:21.988688 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0f619fe3-de8f-4a2b-b84c-07872f349134 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:21.989507 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0f619fe3-de8f-4a2b-b84c-07872f349134 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:22.141293 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-0f619fe3-de8f-4a2b-b84c-07872f349134 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:22.160869 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-0f619fe3-de8f-4a2b-b84c-07872f349134 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:22.163432 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-0f619fe3-de8f-4a2b-b84c-07872f349134 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:22.164822 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-0f619fe3-de8f-4a2b-b84c-07872f349134 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1333 microversion: 2.20 time: 0.193475 Oct 12 04:17:22.165596 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 36/78] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:17:21 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1333 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:17:22.210795 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-72e4221d-e328-4134-a3e1-bbad82ec7243 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:22.220407 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-72e4221d-e328-4134-a3e1-bbad82ec7243 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa" status: 200 len: 1317 microversion: 2.1 time: 0.470731 Oct 12 04:17:22.221775 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 43/79] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:21 2021] GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa => generated 1317 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:22.397010 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-cfd41f7c-f96c-49a2-9762-2aacf8cf811c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:22.398784 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-cfd41f7c-f96c-49a2-9762-2aacf8cf811c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:22.411063 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-cfd41f7c-f96c-49a2-9762-2aacf8cf811c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:22.411516 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-cfd41f7c-f96c-49a2-9762-2aacf8cf811c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:22.412301 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-cfd41f7c-f96c-49a2-9762-2aacf8cf811c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:22.412730 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-cfd41f7c-f96c-49a2-9762-2aacf8cf811c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:22.558551 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-70c669c3-40ce-4f4f-8074-5e7ec92d3c19 req-50543387-7042-49cc-808e-ef5e075e1b80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92d84886-10fd-4ae9-a6fa-6c0a75409709", "tag": "daa88131-1b96-4370-98b3-d5a9a75dda98"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:22.565760 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:17:22.565760 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:17:22.581626 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-70c669c3-40ce-4f4f-8074-5e7ec92d3c19 req-50543387-7042-49cc-808e-ef5e075e1b80 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:22.582340 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-70c669c3-40ce-4f4f-8074-5e7ec92d3c19 req-50543387-7042-49cc-808e-ef5e075e1b80 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:22.602564 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-70c669c3-40ce-4f4f-8074-5e7ec92d3c19 req-50543387-7042-49cc-808e-ef5e075e1b80 service nova] Creating event network-changed:daa88131-1b96-4370-98b3-d5a9a75dda98 for instance 92d84886-10fd-4ae9-a6fa-6c0a75409709 on hv-cinder-81306 Oct 12 04:17:22.608493 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-70c669c3-40ce-4f4f-8074-5e7ec92d3c19 req-50543387-7042-49cc-808e-ef5e075e1b80 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062569 Oct 12 04:17:22.609840 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 44/80] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:17:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:17:22.617219 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-8ea922eb-7d22-4ff0-8da8-a96ca6da679e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:22.633262 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-8ea922eb-7d22-4ff0-8da8-a96ca6da679e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:22.649836 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8ea922eb-7d22-4ff0-8da8-a96ca6da679e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:22.652845 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8ea922eb-7d22-4ff0-8da8-a96ca6da679e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:22.653899 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8ea922eb-7d22-4ff0-8da8-a96ca6da679e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:22.654502 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8ea922eb-7d22-4ff0-8da8-a96ca6da679e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:22.713009 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-cfd41f7c-f96c-49a2-9762-2aacf8cf811c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:22.722100 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-cfd41f7c-f96c-49a2-9762-2aacf8cf811c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1361 microversion: 2.1 time: 0.331357 Oct 12 04:17:22.726166 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 37/81] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:22 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1361 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:22.747020 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-e032d8f7-d503-4294-a54c-e9f93d0c877f tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:22.747020 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-e032d8f7-d503-4294-a54c-e9f93d0c877f tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:22.778000 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e032d8f7-d503-4294-a54c-e9f93d0c877f tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:22.783247 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e032d8f7-d503-4294-a54c-e9f93d0c877f tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:22.784713 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e032d8f7-d503-4294-a54c-e9f93d0c877f tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:22.787267 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e032d8f7-d503-4294-a54c-e9f93d0c877f tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:23.059784 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-8ea922eb-7d22-4ff0-8da8-a96ca6da679e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:23.071685 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-8ea922eb-7d22-4ff0-8da8-a96ca6da679e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1322 microversion: 2.1 time: 0.460183 Oct 12 04:17:23.073083 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 45/82] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:22 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1322 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:23.127122 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-e032d8f7-d503-4294-a54c-e9f93d0c877f tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd523d965976493ba50e4154e90b123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7333a6b7535c4821b8eefd5dd71e4e6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:23.148128 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-e032d8f7-d503-4294-a54c-e9f93d0c877f tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 200 len: 1315 microversion: 2.1 time: 0.419279 Oct 12 04:17:23.149552 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 38/83] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:22 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:23.184241 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-dbf6a1fa-e579-472c-81cc-5f571462bd19 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:23.184980 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-dbf6a1fa-e579-472c-81cc-5f571462bd19 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:23.192036 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-12ef3600-dd78-4c04-866f-31f4d1d513fa req-1fa1c187-c224-4bb6-9271-263d44161bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61a95157-07b2-4d52-a3b5-51e526f99b31", "name": "network-vif-plugged", "status": "completed", "tag": "45453f45-d5d3-4d04-be84-0088e8ca1bff"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:23.193654 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:17:23.193654 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:17:23.212075 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-dbf6a1fa-e579-472c-81cc-5f571462bd19 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:23.212524 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-dbf6a1fa-e579-472c-81cc-5f571462bd19 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:23.213306 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-dbf6a1fa-e579-472c-81cc-5f571462bd19 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:23.213738 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-dbf6a1fa-e579-472c-81cc-5f571462bd19 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:23.215271 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-12ef3600-dd78-4c04-866f-31f4d1d513fa req-1fa1c187-c224-4bb6-9271-263d44161bb6 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:23.215732 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-12ef3600-dd78-4c04-866f-31f4d1d513fa req-1fa1c187-c224-4bb6-9271-263d44161bb6 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:23.257567 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-12ef3600-dd78-4c04-866f-31f4d1d513fa req-1fa1c187-c224-4bb6-9271-263d44161bb6 service nova] Creating event network-vif-plugged:45453f45-d5d3-4d04-be84-0088e8ca1bff for instance 61a95157-07b2-4d52-a3b5-51e526f99b31 on hv-cinder-81306 Oct 12 04:17:23.268963 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-12ef3600-dd78-4c04-866f-31f4d1d513fa req-1fa1c187-c224-4bb6-9271-263d44161bb6 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194330 Oct 12 04:17:23.270180 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 46/84] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:17:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:17:23.277448 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-fef8b005-a489-44d1-81b4-389b7ed613b0 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:23.350163 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-fef8b005-a489-44d1-81b4-389b7ed613b0 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:23.350163 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fef8b005-a489-44d1-81b4-389b7ed613b0 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:23.350163 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fef8b005-a489-44d1-81b4-389b7ed613b0 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:23.350163 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fef8b005-a489-44d1-81b4-389b7ed613b0 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:23.351471 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fef8b005-a489-44d1-81b4-389b7ed613b0 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:23.351693 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-dbf6a1fa-e579-472c-81cc-5f571462bd19 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:23.357058 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-dbf6a1fa-e579-472c-81cc-5f571462bd19 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:23.358579 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-dbf6a1fa-e579-472c-81cc-5f571462bd19 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:23.359869 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-dbf6a1fa-e579-472c-81cc-5f571462bd19 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1339 microversion: 2.20 time: 0.179559 Oct 12 04:17:23.360897 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 39/85] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:17:23 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1339 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:17:23.567271 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-fef8b005-a489-44d1-81b4-389b7ed613b0 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:23.572071 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-fef8b005-a489-44d1-81b4-389b7ed613b0 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa" status: 200 len: 1317 microversion: 2.1 time: 0.300717 Oct 12 04:17:23.573579 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 47/86] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:23 2021] GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:23.742377 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-60765ee0-a49c-4edb-a1ac-a08a03b8fe24 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:23.743085 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-60765ee0-a49c-4edb-a1ac-a08a03b8fe24 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:23.750104 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-60765ee0-a49c-4edb-a1ac-a08a03b8fe24 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:23.756001 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-60765ee0-a49c-4edb-a1ac-a08a03b8fe24 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:23.757070 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-60765ee0-a49c-4edb-a1ac-a08a03b8fe24 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:23.758072 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-60765ee0-a49c-4edb-a1ac-a08a03b8fe24 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:23.994441 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-60765ee0-a49c-4edb-a1ac-a08a03b8fe24 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:24.007326 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-60765ee0-a49c-4edb-a1ac-a08a03b8fe24 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1361 microversion: 2.1 time: 0.268234 Oct 12 04:17:24.020719 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 40/87] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:23 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1361 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:24.089929 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-800ad0e7-2824-421b-8384-ae1d3cd25d10 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:24.090637 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-800ad0e7-2824-421b-8384-ae1d3cd25d10 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:24.098217 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-800ad0e7-2824-421b-8384-ae1d3cd25d10 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:24.098880 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-800ad0e7-2824-421b-8384-ae1d3cd25d10 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:24.099923 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-800ad0e7-2824-421b-8384-ae1d3cd25d10 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:24.101154 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-800ad0e7-2824-421b-8384-ae1d3cd25d10 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:24.166247 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-9a8de514-6e3a-406a-8a9a-46bdf9e66dd8 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:24.168057 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-9a8de514-6e3a-406a-8a9a-46bdf9e66dd8 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:24.174983 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9a8de514-6e3a-406a-8a9a-46bdf9e66dd8 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:24.175539 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9a8de514-6e3a-406a-8a9a-46bdf9e66dd8 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:24.176387 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9a8de514-6e3a-406a-8a9a-46bdf9e66dd8 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:24.176889 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9a8de514-6e3a-406a-8a9a-46bdf9e66dd8 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:24.481821 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-800ad0e7-2824-421b-8384-ae1d3cd25d10 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:24.492704 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-800ad0e7-2824-421b-8384-ae1d3cd25d10 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1322 microversion: 2.1 time: 0.406601 Oct 12 04:17:24.504021 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 48/88] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:24 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1322 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:24.509615 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-d069295d-d585-4828-aea1-34c75fb1d246 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:24.510565 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-d069295d-d585-4828-aea1-34c75fb1d246 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:24.520056 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d069295d-d585-4828-aea1-34c75fb1d246 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:24.520914 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d069295d-d585-4828-aea1-34c75fb1d246 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:24.521889 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d069295d-d585-4828-aea1-34c75fb1d246 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:24.522511 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d069295d-d585-4828-aea1-34c75fb1d246 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:24.542490 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-9a8de514-6e3a-406a-8a9a-46bdf9e66dd8 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd523d965976493ba50e4154e90b123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7333a6b7535c4821b8eefd5dd71e4e6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:24.581920 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-9a8de514-6e3a-406a-8a9a-46bdf9e66dd8 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 200 len: 1315 microversion: 2.1 time: 0.419297 Oct 12 04:17:24.588576 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 41/89] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:24 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:24.602442 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-b969d52e-880c-4f3d-9ef1-5acfa21f4626 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:24.604128 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-b969d52e-880c-4f3d-9ef1-5acfa21f4626 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:24.618384 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b969d52e-880c-4f3d-9ef1-5acfa21f4626 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:24.623336 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b969d52e-880c-4f3d-9ef1-5acfa21f4626 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:24.624973 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b969d52e-880c-4f3d-9ef1-5acfa21f4626 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:24.625513 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b969d52e-880c-4f3d-9ef1-5acfa21f4626 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:25.144258 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-b969d52e-880c-4f3d-9ef1-5acfa21f4626 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:25.147301 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-d069295d-d585-4828-aea1-34c75fb1d246 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:25.161014 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-d069295d-d585-4828-aea1-34c75fb1d246 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:25.164349 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-b969d52e-880c-4f3d-9ef1-5acfa21f4626 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa" status: 200 len: 1317 microversion: 2.1 time: 0.574969 Oct 12 04:17:25.164487 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-d069295d-d585-4828-aea1-34c75fb1d246 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:25.164593 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 42/90] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:24 2021] GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa => generated 1317 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:25.169581 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-c807b979-cce3-4448-8e38-5781b3086ae9 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:25.170807 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-c807b979-cce3-4448-8e38-5781b3086ae9 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:25.173711 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-d069295d-d585-4828-aea1-34c75fb1d246 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1406 microversion: 2.20 time: 0.668269 Oct 12 04:17:25.177659 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c807b979-cce3-4448-8e38-5781b3086ae9 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:25.177801 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 49/91] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:17:24 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1406 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:17:25.178486 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c807b979-cce3-4448-8e38-5781b3086ae9 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:25.179625 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c807b979-cce3-4448-8e38-5781b3086ae9 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:25.182014 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c807b979-cce3-4448-8e38-5781b3086ae9 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:25.298621 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-1c6dfd60-7284-4435-8125-803ce6b5126e req-f92e656a-433c-45db-a7bc-021a5dcbbe50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29fcfae4-9349-4167-9403-9a4a20f346bd", "tag": "c5a9a497-7d69-4ed5-85cb-fa9a1cc1b4bf"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:25.305614 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:17:25.305614 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:17:25.332869 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-1c6dfd60-7284-4435-8125-803ce6b5126e req-f92e656a-433c-45db-a7bc-021a5dcbbe50 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:25.333844 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-1c6dfd60-7284-4435-8125-803ce6b5126e req-f92e656a-433c-45db-a7bc-021a5dcbbe50 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:25.347669 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-1c6dfd60-7284-4435-8125-803ce6b5126e req-f92e656a-433c-45db-a7bc-021a5dcbbe50 service nova] Creating event network-changed:c5a9a497-7d69-4ed5-85cb-fa9a1cc1b4bf for instance 29fcfae4-9349-4167-9403-9a4a20f346bd on hv-cinder-81306 Oct 12 04:17:25.358252 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-1c6dfd60-7284-4435-8125-803ce6b5126e req-f92e656a-433c-45db-a7bc-021a5dcbbe50 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064048 Oct 12 04:17:25.359503 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 50/92] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:17:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:17:25.376022 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-e29c4180-8cc0-4b02-be31-f86cc82cfb3a req-5939297a-e4b7-4d7b-8ff3-49c2143c2439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "494a399f-a68d-4e9f-8259-fbe4f5b830fa", "name": "network-vif-plugged", "status": "completed", "tag": "e338ea68-ade7-4184-bc31-d3b708620700"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:25.377015 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:17:25.377015 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:17:25.387023 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-e29c4180-8cc0-4b02-be31-f86cc82cfb3a req-5939297a-e4b7-4d7b-8ff3-49c2143c2439 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:25.392648 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-e29c4180-8cc0-4b02-be31-f86cc82cfb3a req-5939297a-e4b7-4d7b-8ff3-49c2143c2439 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:25.429065 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-e29c4180-8cc0-4b02-be31-f86cc82cfb3a req-5939297a-e4b7-4d7b-8ff3-49c2143c2439 service nova] Creating event network-vif-plugged:e338ea68-ade7-4184-bc31-d3b708620700 for instance 494a399f-a68d-4e9f-8259-fbe4f5b830fa on hv-cinder-81306 Oct 12 04:17:25.439448 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-e29c4180-8cc0-4b02-be31-f86cc82cfb3a req-5939297a-e4b7-4d7b-8ff3-49c2143c2439 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076878 Oct 12 04:17:25.444839 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 51/93] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:17:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:17:25.469516 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c807b979-cce3-4448-8e38-5781b3086ae9 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:25.478358 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-c807b979-cce3-4448-8e38-5781b3086ae9 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1361 microversion: 2.1 time: 0.313808 Oct 12 04:17:25.483298 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 43/94] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:25 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1361 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:25.511378 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-19e8d369-e5fe-454b-a8c3-be591d995e8c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:25.512078 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-19e8d369-e5fe-454b-a8c3-be591d995e8c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:25.519573 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-19e8d369-e5fe-454b-a8c3-be591d995e8c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:25.520027 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-19e8d369-e5fe-454b-a8c3-be591d995e8c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:25.521272 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-19e8d369-e5fe-454b-a8c3-be591d995e8c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:25.521764 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-19e8d369-e5fe-454b-a8c3-be591d995e8c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:25.605233 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-c3038b21-ca51-4dd6-b218-d1fb807c5f90 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:25.605842 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-c3038b21-ca51-4dd6-b218-d1fb807c5f90 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:25.614908 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c3038b21-ca51-4dd6-b218-d1fb807c5f90 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:25.615458 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c3038b21-ca51-4dd6-b218-d1fb807c5f90 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:25.616148 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c3038b21-ca51-4dd6-b218-d1fb807c5f90 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:25.616605 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c3038b21-ca51-4dd6-b218-d1fb807c5f90 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:25.722613 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-19e8d369-e5fe-454b-a8c3-be591d995e8c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:25.730084 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-19e8d369-e5fe-454b-a8c3-be591d995e8c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1322 microversion: 2.1 time: 0.223507 Oct 12 04:17:25.730946 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 52/95] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:25 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:25.844912 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c3038b21-ca51-4dd6-b218-d1fb807c5f90 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd523d965976493ba50e4154e90b123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7333a6b7535c4821b8eefd5dd71e4e6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:25.846305 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-c3038b21-ca51-4dd6-b218-d1fb807c5f90 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 200 len: 1315 microversion: 2.1 time: 0.244742 Oct 12 04:17:25.847024 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 44/96] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:25 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:26.182196 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-e963a7fb-4570-4f91-8d76-79fce62e2d9e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:26.184030 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-e963a7fb-4570-4f91-8d76-79fce62e2d9e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:26.195479 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-9d7bec1d-ea8f-4852-b812-ca81a3c9c886 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:26.196089 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-9d7bec1d-ea8f-4852-b812-ca81a3c9c886 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:26.200777 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e963a7fb-4570-4f91-8d76-79fce62e2d9e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:26.204105 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e963a7fb-4570-4f91-8d76-79fce62e2d9e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:26.208822 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e963a7fb-4570-4f91-8d76-79fce62e2d9e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:26.209799 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e963a7fb-4570-4f91-8d76-79fce62e2d9e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:26.224384 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9d7bec1d-ea8f-4852-b812-ca81a3c9c886 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:26.224384 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9d7bec1d-ea8f-4852-b812-ca81a3c9c886 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:26.224384 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9d7bec1d-ea8f-4852-b812-ca81a3c9c886 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:26.224384 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9d7bec1d-ea8f-4852-b812-ca81a3c9c886 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:26.459259 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-e963a7fb-4570-4f91-8d76-79fce62e2d9e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:26.467354 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-9d7bec1d-ea8f-4852-b812-ca81a3c9c886 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:26.469211 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-e963a7fb-4570-4f91-8d76-79fce62e2d9e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa" status: 200 len: 1317 microversion: 2.1 time: 0.292793 Oct 12 04:17:26.470051 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 53/97] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:26 2021] GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:26.478865 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-9d7bec1d-ea8f-4852-b812-ca81a3c9c886 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:26.480250 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-9d7bec1d-ea8f-4852-b812-ca81a3c9c886 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:26.481700 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-9d7bec1d-ea8f-4852-b812-ca81a3c9c886 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1406 microversion: 2.20 time: 0.289895 Oct 12 04:17:26.482605 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 45/98] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:17:26 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1406 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:17:26.502836 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ee35adfa-dc3a-4185-9e4e-330c33d21253 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:26.503729 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ee35adfa-dc3a-4185-9e4e-330c33d21253 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:26.511250 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ee35adfa-dc3a-4185-9e4e-330c33d21253 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:26.511932 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ee35adfa-dc3a-4185-9e4e-330c33d21253 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:26.512991 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ee35adfa-dc3a-4185-9e4e-330c33d21253 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:26.513581 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ee35adfa-dc3a-4185-9e4e-330c33d21253 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:26.710795 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-ee35adfa-dc3a-4185-9e4e-330c33d21253 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:26.717360 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ee35adfa-dc3a-4185-9e4e-330c33d21253 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1361 microversion: 2.1 time: 0.221234 Oct 12 04:17:26.717943 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 54/99] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:26 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1361 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:26.748210 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-8d9d75fb-1d61-4ee7-834e-4528fb791e62 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:26.749882 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-8d9d75fb-1d61-4ee7-834e-4528fb791e62 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:26.763852 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8d9d75fb-1d61-4ee7-834e-4528fb791e62 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:26.764319 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8d9d75fb-1d61-4ee7-834e-4528fb791e62 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:26.767856 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8d9d75fb-1d61-4ee7-834e-4528fb791e62 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:26.768784 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8d9d75fb-1d61-4ee7-834e-4528fb791e62 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:26.864967 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-5670659d-ef70-4b8b-a716-32a23ad3be33 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:26.865701 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-5670659d-ef70-4b8b-a716-32a23ad3be33 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:26.872338 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5670659d-ef70-4b8b-a716-32a23ad3be33 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:26.877163 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5670659d-ef70-4b8b-a716-32a23ad3be33 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:26.877163 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5670659d-ef70-4b8b-a716-32a23ad3be33 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:26.877163 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5670659d-ef70-4b8b-a716-32a23ad3be33 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:27.078399 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-8d9d75fb-1d61-4ee7-834e-4528fb791e62 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:27.086039 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-8d9d75fb-1d61-4ee7-834e-4528fb791e62 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1322 microversion: 2.1 time: 0.341509 Oct 12 04:17:27.086608 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 46/100] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:26 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1322 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:27.159206 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-5670659d-ef70-4b8b-a716-32a23ad3be33 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd523d965976493ba50e4154e90b123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7333a6b7535c4821b8eefd5dd71e4e6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:27.167782 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-5670659d-ef70-4b8b-a716-32a23ad3be33 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 200 len: 1501 microversion: 2.1 time: 0.308724 Oct 12 04:17:27.168349 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 55/101] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:26 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 1501 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:27.459640 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-956ce779-5894-44cb-b195-f07d547206d9 req-0e257586-6072-443a-863a-53ad1d3e81f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d927fdb5-40b1-4279-9f0c-7006831e05d2", "name": "network-vif-plugged", "status": "completed", "tag": "820be35b-a456-4989-96da-b067b6759731"}, {"server_uuid": "92d84886-10fd-4ae9-a6fa-6c0a75409709", "name": "network-vif-plugged", "status": "completed", "tag": "daa88131-1b96-4370-98b3-d5a9a75dda98"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:27.461791 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:17:27.461791 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:17:27.476356 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-956ce779-5894-44cb-b195-f07d547206d9 req-0e257586-6072-443a-863a-53ad1d3e81f8 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:27.476796 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-956ce779-5894-44cb-b195-f07d547206d9 req-0e257586-6072-443a-863a-53ad1d3e81f8 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:27.486882 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-5b86862e-c15f-4ef4-b6b2-853ce32ba12a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:27.488984 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-5b86862e-c15f-4ef4-b6b2-853ce32ba12a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:27.491083 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-956ce779-5894-44cb-b195-f07d547206d9 req-0e257586-6072-443a-863a-53ad1d3e81f8 service nova] Creating event network-vif-plugged:820be35b-a456-4989-96da-b067b6759731 for instance d927fdb5-40b1-4279-9f0c-7006831e05d2 on hv-cinder-81306 Oct 12 04:17:27.491590 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-956ce779-5894-44cb-b195-f07d547206d9 req-0e257586-6072-443a-863a-53ad1d3e81f8 service nova] Creating event network-vif-plugged:daa88131-1b96-4370-98b3-d5a9a75dda98 for instance 92d84886-10fd-4ae9-a6fa-6c0a75409709 on hv-cinder-81306 Oct 12 04:17:27.494471 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5b86862e-c15f-4ef4-b6b2-853ce32ba12a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:27.498418 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-956ce779-5894-44cb-b195-f07d547206d9 req-0e257586-6072-443a-863a-53ad1d3e81f8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044932 Oct 12 04:17:27.499576 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 47/102] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:17:27 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:17:27.500198 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5b86862e-c15f-4ef4-b6b2-853ce32ba12a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:27.501102 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5b86862e-c15f-4ef4-b6b2-853ce32ba12a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:27.504018 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5b86862e-c15f-4ef4-b6b2-853ce32ba12a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:27.504328 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-8a677243-a681-4976-b2cb-25c051874185 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:27.505090 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-8a677243-a681-4976-b2cb-25c051874185 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:27.511479 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8a677243-a681-4976-b2cb-25c051874185 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:27.512728 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8a677243-a681-4976-b2cb-25c051874185 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:27.512902 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8a677243-a681-4976-b2cb-25c051874185 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:27.513619 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8a677243-a681-4976-b2cb-25c051874185 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:27.721518 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-5b86862e-c15f-4ef4-b6b2-853ce32ba12a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:27.726223 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-8a677243-a681-4976-b2cb-25c051874185 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:27.732705 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-5b86862e-c15f-4ef4-b6b2-853ce32ba12a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa" status: 200 len: 1507 microversion: 2.1 time: 0.249987 Oct 12 04:17:27.734095 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 56/103] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:27 2021] GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa => generated 1507 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:27.737471 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-8a677243-a681-4976-b2cb-25c051874185 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:27.739250 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-8a677243-a681-4976-b2cb-25c051874185 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:27.740637 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-8a677243-a681-4976-b2cb-25c051874185 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1406 microversion: 2.20 time: 0.239918 Oct 12 04:17:27.741375 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 48/104] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:17:27 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:17:27.743062 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ab017ade-915f-4cdc-b4b9-0845d3b5b88f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:27.743938 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ab017ade-915f-4cdc-b4b9-0845d3b5b88f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:27.750408 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ab017ade-915f-4cdc-b4b9-0845d3b5b88f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:27.751218 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ab017ade-915f-4cdc-b4b9-0845d3b5b88f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:27.752065 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ab017ade-915f-4cdc-b4b9-0845d3b5b88f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:27.752925 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ab017ade-915f-4cdc-b4b9-0845d3b5b88f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:28.028362 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-ab017ade-915f-4cdc-b4b9-0845d3b5b88f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:28.028362 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ab017ade-915f-4cdc-b4b9-0845d3b5b88f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1361 microversion: 2.1 time: 0.291575 Oct 12 04:17:28.028362 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 57/105] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:27 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1361 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:28.111166 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-8ef55638-f253-457b-a5c4-dcd0898f193e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:28.114266 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-8ef55638-f253-457b-a5c4-dcd0898f193e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:28.118810 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8ef55638-f253-457b-a5c4-dcd0898f193e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:28.119274 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8ef55638-f253-457b-a5c4-dcd0898f193e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:28.120125 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8ef55638-f253-457b-a5c4-dcd0898f193e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:28.120451 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8ef55638-f253-457b-a5c4-dcd0898f193e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:28.346335 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-8ef55638-f253-457b-a5c4-dcd0898f193e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:28.355012 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-8ef55638-f253-457b-a5c4-dcd0898f193e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1322 microversion: 2.1 time: 0.256070 Oct 12 04:17:28.369197 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 49/106] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:28 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:28.760988 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-5bfc1ae7-4917-4e81-b332-9cff3d67a612 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:28.761596 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-5bfc1ae7-4917-4e81-b332-9cff3d67a612 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:28.767631 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5bfc1ae7-4917-4e81-b332-9cff3d67a612 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:28.768140 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5bfc1ae7-4917-4e81-b332-9cff3d67a612 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:28.769077 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5bfc1ae7-4917-4e81-b332-9cff3d67a612 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:28.769504 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5bfc1ae7-4917-4e81-b332-9cff3d67a612 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:28.942522 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-5bfc1ae7-4917-4e81-b332-9cff3d67a612 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:28.954502 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-5bfc1ae7-4917-4e81-b332-9cff3d67a612 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:28.956369 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-5bfc1ae7-4917-4e81-b332-9cff3d67a612 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:28.959158 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-5bfc1ae7-4917-4e81-b332-9cff3d67a612 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1406 microversion: 2.20 time: 0.203339 Oct 12 04:17:28.960807 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 58/107] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:17:28 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:17:29.006490 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-2d4a7244-6b89-409c-9cc5-88b6003a6d00 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a4025fc-85a0-48be-aa3d-9ae043e10d70"}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:29.007857 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-2d4a7244-6b89-409c-9cc5-88b6003a6d00 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:29.013915 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2d4a7244-6b89-409c-9cc5-88b6003a6d00 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:29.014698 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2d4a7244-6b89-409c-9cc5-88b6003a6d00 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:29.015663 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2d4a7244-6b89-409c-9cc5-88b6003a6d00 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:29.016388 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2d4a7244-6b89-409c-9cc5-88b6003a6d00 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:29.044944 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-2d995eab-b538-4069-816b-2f9422a729c0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:29.045685 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-2d995eab-b538-4069-816b-2f9422a729c0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:29.052722 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2d995eab-b538-4069-816b-2f9422a729c0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:29.053172 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2d995eab-b538-4069-816b-2f9422a729c0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:29.054061 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2d995eab-b538-4069-816b-2f9422a729c0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:29.054650 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2d995eab-b538-4069-816b-2f9422a729c0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:29.252965 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-2d995eab-b538-4069-816b-2f9422a729c0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:29.261320 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-2d995eab-b538-4069-816b-2f9422a729c0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1361 microversion: 2.1 time: 0.220301 Oct 12 04:17:29.261893 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 59/108] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:29 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1361 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:29.387722 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-177a7c59-ab45-48e7-a651-2fef9ba69559 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:29.388227 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-177a7c59-ab45-48e7-a651-2fef9ba69559 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:29.395243 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-177a7c59-ab45-48e7-a651-2fef9ba69559 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:29.395690 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-177a7c59-ab45-48e7-a651-2fef9ba69559 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:29.396451 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-177a7c59-ab45-48e7-a651-2fef9ba69559 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:29.396887 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-177a7c59-ab45-48e7-a651-2fef9ba69559 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:29.598373 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-177a7c59-ab45-48e7-a651-2fef9ba69559 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:29.615340 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-177a7c59-ab45-48e7-a651-2fef9ba69559 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1322 microversion: 2.1 time: 0.224022 Oct 12 04:17:29.615340 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 60/109] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:29 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:29.622874 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-07e32ba5-d79d-4cfb-a427-bbfa7f7e039e req-3b14a28c-c3af-4052-b52c-07fe393d96f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbee8a27-52f2-42c0-8cb5-bfade5bfb587", "name": "network-vif-plugged", "status": "completed", "tag": "8580464d-5ebb-48ed-ba90-238466c4d35b"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:29.624573 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:17:29.624573 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:17:29.631371 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-07e32ba5-d79d-4cfb-a427-bbfa7f7e039e req-3b14a28c-c3af-4052-b52c-07fe393d96f2 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:29.631806 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-07e32ba5-d79d-4cfb-a427-bbfa7f7e039e req-3b14a28c-c3af-4052-b52c-07fe393d96f2 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:29.643250 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-07e32ba5-d79d-4cfb-a427-bbfa7f7e039e req-3b14a28c-c3af-4052-b52c-07fe393d96f2 service nova] Creating event network-vif-plugged:8580464d-5ebb-48ed-ba90-238466c4d35b for instance bbee8a27-52f2-42c0-8cb5-bfade5bfb587 on hv-cinder-81306 Oct 12 04:17:29.648457 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-07e32ba5-d79d-4cfb-a427-bbfa7f7e039e req-3b14a28c-c3af-4052-b52c-07fe393d96f2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032478 Oct 12 04:17:29.649030 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 61/110] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:17:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:17:29.655952 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-619a7b41-5f4f-48a5-87f2-611c27eb0dfd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b56d4036-e6fa-4029-a036-af3509100c27"}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:29.657113 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-619a7b41-5f4f-48a5-87f2-611c27eb0dfd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:29.663277 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-619a7b41-5f4f-48a5-87f2-611c27eb0dfd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:29.663723 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-619a7b41-5f4f-48a5-87f2-611c27eb0dfd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:29.664483 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-619a7b41-5f4f-48a5-87f2-611c27eb0dfd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:29.665074 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-619a7b41-5f4f-48a5-87f2-611c27eb0dfd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:30.256487 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-2d4a7244-6b89-409c-9cc5-88b6003a6d00 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "POST /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.254650 Oct 12 04:17:30.261670 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 50/111] 10.222.0.21 () {60 vars in 1322 bytes} [Tue Oct 12 04:17:28 2021] POST /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31/os-volume_attachments => generated 194 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:17:30.262507 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-683b19a0-08c7-4e12-987c-ebb83291f88d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:30.263298 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-683b19a0-08c7-4e12-987c-ebb83291f88d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:30.269281 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-683b19a0-08c7-4e12-987c-ebb83291f88d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:30.269725 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-683b19a0-08c7-4e12-987c-ebb83291f88d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:30.270488 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-683b19a0-08c7-4e12-987c-ebb83291f88d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:30.271050 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-683b19a0-08c7-4e12-987c-ebb83291f88d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:30.423490 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-683b19a0-08c7-4e12-987c-ebb83291f88d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:30.431728 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-683b19a0-08c7-4e12-987c-ebb83291f88d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:30.433581 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-683b19a0-08c7-4e12-987c-ebb83291f88d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:30.434976 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-683b19a0-08c7-4e12-987c-ebb83291f88d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1406 microversion: 2.20 time: 0.176356 Oct 12 04:17:30.446345 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 51/112] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:17:30 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:17:30.452751 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-be70e05b-4ed9-4045-a94b-0115265e703b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:30.453460 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-be70e05b-4ed9-4045-a94b-0115265e703b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:30.460426 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-be70e05b-4ed9-4045-a94b-0115265e703b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:30.461152 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-be70e05b-4ed9-4045-a94b-0115265e703b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:30.462007 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-be70e05b-4ed9-4045-a94b-0115265e703b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:30.462508 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-be70e05b-4ed9-4045-a94b-0115265e703b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:30.598217 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-be70e05b-4ed9-4045-a94b-0115265e703b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:30.605076 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-be70e05b-4ed9-4045-a94b-0115265e703b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1361 microversion: 2.1 time: 0.157373 Oct 12 04:17:30.605645 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 52/113] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:30 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:30.625875 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-f29b103f-2040-405e-97be-93f8afbb701c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:30.626445 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-f29b103f-2040-405e-97be-93f8afbb701c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:30.632361 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f29b103f-2040-405e-97be-93f8afbb701c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:30.632814 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f29b103f-2040-405e-97be-93f8afbb701c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:30.633663 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f29b103f-2040-405e-97be-93f8afbb701c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:30.633994 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f29b103f-2040-405e-97be-93f8afbb701c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:30.753870 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-619a7b41-5f4f-48a5-87f2-611c27eb0dfd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "POST /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.103481 Oct 12 04:17:30.759646 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 62/114] 10.222.0.21 () {60 vars in 1322 bytes} [Tue Oct 12 04:17:29 2021] POST /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa/os-volume_attachments => generated 194 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:17:30.771270 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-f29b103f-2040-405e-97be-93f8afbb701c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:30.780797 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-f29b103f-2040-405e-97be-93f8afbb701c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1516 microversion: 2.1 time: 0.158559 Oct 12 04:17:30.781361 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 53/115] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:30 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:30.804275 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-c99eeecf-fdf3-4a75-839e-a8ae4b6620fd tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:30.806005 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-c99eeecf-fdf3-4a75-839e-a8ae4b6620fd tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:30.812285 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c99eeecf-fdf3-4a75-839e-a8ae4b6620fd tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:30.812977 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c99eeecf-fdf3-4a75-839e-a8ae4b6620fd tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:30.814072 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c99eeecf-fdf3-4a75-839e-a8ae4b6620fd tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:30.814495 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c99eeecf-fdf3-4a75-839e-a8ae4b6620fd tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:30.845424 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.objects.instance [None req-c99eeecf-fdf3-4a75-839e-a8ae4b6620fd tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lazy-loading 'flavor' on Instance uuid 92d84886-10fd-4ae9-a6fa-6c0a75409709 {{(pid=108897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:17:31.243781 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-c99eeecf-fdf3-4a75-839e-a8ae4b6620fd tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "POST /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709/action" status: 200 len: 32 microversion: 2.1 time: 0.447662 Oct 12 04:17:31.244489 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 63/116] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:17:30 2021] POST /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709/action => generated 32 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 04:17:31.254237 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-eb1e6d91-0d1f-4edf-a501-7b872875a907 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:31.254920 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-eb1e6d91-0d1f-4edf-a501-7b872875a907 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:31.265489 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-eb1e6d91-0d1f-4edf-a501-7b872875a907 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:31.265489 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-eb1e6d91-0d1f-4edf-a501-7b872875a907 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:31.265489 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-eb1e6d91-0d1f-4edf-a501-7b872875a907 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:31.265489 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-eb1e6d91-0d1f-4edf-a501-7b872875a907 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:31.405535 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-eb1e6d91-0d1f-4edf-a501-7b872875a907 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:31.413440 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-eb1e6d91-0d1f-4edf-a501-7b872875a907 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.163076 Oct 12 04:17:31.414329 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 54/117] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:31 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:31.457874 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-0de9578f-07f1-4a2f-831f-5e633804afaa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:31.460216 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-0de9578f-07f1-4a2f-831f-5e633804afaa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:31.464499 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0de9578f-07f1-4a2f-831f-5e633804afaa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:31.465055 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0de9578f-07f1-4a2f-831f-5e633804afaa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:31.465889 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0de9578f-07f1-4a2f-831f-5e633804afaa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:31.466322 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0de9578f-07f1-4a2f-831f-5e633804afaa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:31.624946 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-89898f1a-964a-4211-b093-565ff4466afd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:31.627132 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-89898f1a-964a-4211-b093-565ff4466afd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:31.636494 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-89898f1a-964a-4211-b093-565ff4466afd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:31.637178 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-89898f1a-964a-4211-b093-565ff4466afd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:31.638434 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-89898f1a-964a-4211-b093-565ff4466afd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:31.639258 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-89898f1a-964a-4211-b093-565ff4466afd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:31.759604 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-0de9578f-07f1-4a2f-831f-5e633804afaa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:31.771009 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-0de9578f-07f1-4a2f-831f-5e633804afaa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:31.773126 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-0de9578f-07f1-4a2f-831f-5e633804afaa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:31.774345 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-0de9578f-07f1-4a2f-831f-5e633804afaa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1406 microversion: 2.20 time: 0.323561 Oct 12 04:17:31.775142 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 64/118] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:17:31 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1406 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:17:31.780056 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-e8b9a0ce-5c11-47af-bc95-112dc14d4211 req-12535dc3-6ed9-4725-bf0b-d2c34d0f7999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29fcfae4-9349-4167-9403-9a4a20f346bd", "name": "network-vif-plugged", "status": "completed", "tag": "c5a9a497-7d69-4ed5-85cb-fa9a1cc1b4bf"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:31.782364 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:17:31.782364 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:17:31.789628 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-e8b9a0ce-5c11-47af-bc95-112dc14d4211 req-12535dc3-6ed9-4725-bf0b-d2c34d0f7999 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:31.792079 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-e8b9a0ce-5c11-47af-bc95-112dc14d4211 req-12535dc3-6ed9-4725-bf0b-d2c34d0f7999 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:31.802354 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-e8b9a0ce-5c11-47af-bc95-112dc14d4211 req-12535dc3-6ed9-4725-bf0b-d2c34d0f7999 service nova] Creating event network-vif-plugged:c5a9a497-7d69-4ed5-85cb-fa9a1cc1b4bf for instance 29fcfae4-9349-4167-9403-9a4a20f346bd on hv-cinder-81306 Oct 12 04:17:31.807347 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-e8b9a0ce-5c11-47af-bc95-112dc14d4211 req-12535dc3-6ed9-4725-bf0b-d2c34d0f7999 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030583 Oct 12 04:17:31.808360 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 65/119] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:17:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:17:31.903708 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-89898f1a-964a-4211-b093-565ff4466afd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:31.911434 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-89898f1a-964a-4211-b093-565ff4466afd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1361 microversion: 2.1 time: 0.292090 Oct 12 04:17:31.912238 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 55/120] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:31 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1361 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:32.431195 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-c6028b6d-d842-4d2a-9234-c8891752cf5b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:32.431929 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-c6028b6d-d842-4d2a-9234-c8891752cf5b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:32.438028 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c6028b6d-d842-4d2a-9234-c8891752cf5b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:32.438471 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c6028b6d-d842-4d2a-9234-c8891752cf5b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:32.439308 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c6028b6d-d842-4d2a-9234-c8891752cf5b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:32.439741 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c6028b6d-d842-4d2a-9234-c8891752cf5b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:32.561179 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-c6028b6d-d842-4d2a-9234-c8891752cf5b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:32.568353 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-c6028b6d-d842-4d2a-9234-c8891752cf5b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.141456 Oct 12 04:17:32.568905 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 66/121] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:32 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:32.792834 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-af4891a0-8d06-4bf8-8d8e-cf5cb4fed831 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:32.793433 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-af4891a0-8d06-4bf8-8d8e-cf5cb4fed831 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:32.799596 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-af4891a0-8d06-4bf8-8d8e-cf5cb4fed831 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:32.800056 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-af4891a0-8d06-4bf8-8d8e-cf5cb4fed831 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:32.800801 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-af4891a0-8d06-4bf8-8d8e-cf5cb4fed831 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:32.801224 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-af4891a0-8d06-4bf8-8d8e-cf5cb4fed831 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:32.918542 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-af4891a0-8d06-4bf8-8d8e-cf5cb4fed831 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:32.926312 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-af4891a0-8d06-4bf8-8d8e-cf5cb4fed831 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:32.927987 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-af4891a0-8d06-4bf8-8d8e-cf5cb4fed831 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:32.929073 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-af4891a0-8d06-4bf8-8d8e-cf5cb4fed831 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1406 microversion: 2.20 time: 0.140009 Oct 12 04:17:32.929244 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-efcecb11-e54d-4e0c-89b2-36232e8be3b2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:32.929682 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 56/122] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:17:32 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1406 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:17:32.929860 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-efcecb11-e54d-4e0c-89b2-36232e8be3b2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:32.935796 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-efcecb11-e54d-4e0c-89b2-36232e8be3b2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:32.936242 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-efcecb11-e54d-4e0c-89b2-36232e8be3b2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:32.937546 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-efcecb11-e54d-4e0c-89b2-36232e8be3b2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:32.937983 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-efcecb11-e54d-4e0c-89b2-36232e8be3b2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:33.064576 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-efcecb11-e54d-4e0c-89b2-36232e8be3b2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:33.071791 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-efcecb11-e54d-4e0c-89b2-36232e8be3b2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1546 microversion: 2.1 time: 0.146566 Oct 12 04:17:33.072343 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 67/123] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:32 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1546 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:33.089573 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-9634c605-8526-4da9-b587-eb1ea5741662 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:33.090153 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-9634c605-8526-4da9-b587-eb1ea5741662 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:33.096169 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9634c605-8526-4da9-b587-eb1ea5741662 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:33.096704 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9634c605-8526-4da9-b587-eb1ea5741662 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:33.097540 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9634c605-8526-4da9-b587-eb1ea5741662 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:33.098039 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9634c605-8526-4da9-b587-eb1ea5741662 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:33.177246 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-9634c605-8526-4da9-b587-eb1ea5741662 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091287 Oct 12 04:17:33.177841 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 57/124] 10.222.0.21 () {58 vars in 1274 bytes} [Tue Oct 12 04:17:33 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:17:33.585318 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-8a3dc5ed-8760-45de-83a5-89a00067dbd8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:33.586000 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-8a3dc5ed-8760-45de-83a5-89a00067dbd8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:33.592230 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8a3dc5ed-8760-45de-83a5-89a00067dbd8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:33.593757 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8a3dc5ed-8760-45de-83a5-89a00067dbd8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:33.594591 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8a3dc5ed-8760-45de-83a5-89a00067dbd8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:33.595111 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8a3dc5ed-8760-45de-83a5-89a00067dbd8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:33.958366 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-c623785e-ad57-440f-b092-c7a6c0bfbb21 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:33.958366 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-c623785e-ad57-440f-b092-c7a6c0bfbb21 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:33.966415 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c623785e-ad57-440f-b092-c7a6c0bfbb21 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:33.973647 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c623785e-ad57-440f-b092-c7a6c0bfbb21 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:33.974508 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c623785e-ad57-440f-b092-c7a6c0bfbb21 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:33.974993 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c623785e-ad57-440f-b092-c7a6c0bfbb21 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:34.179374 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-8a3dc5ed-8760-45de-83a5-89a00067dbd8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:34.187192 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-8a3dc5ed-8760-45de-83a5-89a00067dbd8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.605472 Oct 12 04:17:34.195460 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 68/125] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:33 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:34.254211 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c623785e-ad57-440f-b092-c7a6c0bfbb21 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:34.262816 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c623785e-ad57-440f-b092-c7a6c0bfbb21 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:34.267319 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c623785e-ad57-440f-b092-c7a6c0bfbb21 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:34.267319 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-c623785e-ad57-440f-b092-c7a6c0bfbb21 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1598 microversion: 2.20 time: 0.321979 Oct 12 04:17:34.267319 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 58/126] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:17:33 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1598 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:17:34.283790 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-035213c3-6070-4b1c-a8fe-718c3ebea643 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:34.284483 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-035213c3-6070-4b1c-a8fe-718c3ebea643 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:34.291703 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-035213c3-6070-4b1c-a8fe-718c3ebea643 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:34.292151 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-035213c3-6070-4b1c-a8fe-718c3ebea643 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:34.292913 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-035213c3-6070-4b1c-a8fe-718c3ebea643 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:34.293540 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-035213c3-6070-4b1c-a8fe-718c3ebea643 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:34.420495 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-035213c3-6070-4b1c-a8fe-718c3ebea643 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.140314 Oct 12 04:17:34.421066 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 69/127] 10.222.0.21 () {60 vars in 1315 bytes} [Tue Oct 12 04:17:34 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:17:34.778543 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-33cf9070-f87f-4108-9cdb-a91529c29a5d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:34.779928 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-33cf9070-f87f-4108-9cdb-a91529c29a5d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:34.783643 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-5cd44ec4-612f-408f-8a12-ec18ae478b7b req-5b246736-2461-4d81-ae4f-38326c02eb29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbee8a27-52f2-42c0-8cb5-bfade5bfb587", "tag": "8580464d-5ebb-48ed-ba90-238466c4d35b"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:34.789033 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-33cf9070-f87f-4108-9cdb-a91529c29a5d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:34.789477 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-33cf9070-f87f-4108-9cdb-a91529c29a5d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:34.790246 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-33cf9070-f87f-4108-9cdb-a91529c29a5d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:34.790698 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-33cf9070-f87f-4108-9cdb-a91529c29a5d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:34.795377 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:17:34.795377 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:17:34.810420 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-5cd44ec4-612f-408f-8a12-ec18ae478b7b req-5b246736-2461-4d81-ae4f-38326c02eb29 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:34.812229 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-5cd44ec4-612f-408f-8a12-ec18ae478b7b req-5b246736-2461-4d81-ae4f-38326c02eb29 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:34.839169 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-5cd44ec4-612f-408f-8a12-ec18ae478b7b req-5b246736-2461-4d81-ae4f-38326c02eb29 service nova] Creating event network-changed:8580464d-5ebb-48ed-ba90-238466c4d35b for instance bbee8a27-52f2-42c0-8cb5-bfade5bfb587 on hv-cinder-81306 Oct 12 04:17:34.853608 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-5cd44ec4-612f-408f-8a12-ec18ae478b7b req-5b246736-2461-4d81-ae4f-38326c02eb29 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078555 Oct 12 04:17:34.854648 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 70/128] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:17:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:17:35.204591 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-1319f0f6-d3cd-4ea7-9616-ba37e3c04c07 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:35.205269 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-1319f0f6-d3cd-4ea7-9616-ba37e3c04c07 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:35.211571 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1319f0f6-d3cd-4ea7-9616-ba37e3c04c07 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:35.212265 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1319f0f6-d3cd-4ea7-9616-ba37e3c04c07 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:35.213207 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1319f0f6-d3cd-4ea7-9616-ba37e3c04c07 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:35.213665 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1319f0f6-d3cd-4ea7-9616-ba37e3c04c07 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:35.355465 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-1319f0f6-d3cd-4ea7-9616-ba37e3c04c07 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:35.364302 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-1319f0f6-d3cd-4ea7-9616-ba37e3c04c07 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.163580 Oct 12 04:17:35.371520 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 71/129] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:35 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:35.862960 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-214f71d7-c38c-4fb6-afb9-d32331c31865 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:35.863934 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-214f71d7-c38c-4fb6-afb9-d32331c31865 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:35.870092 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-214f71d7-c38c-4fb6-afb9-d32331c31865 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:35.870626 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-214f71d7-c38c-4fb6-afb9-d32331c31865 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:35.871522 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-214f71d7-c38c-4fb6-afb9-d32331c31865 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:35.872011 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-214f71d7-c38c-4fb6-afb9-d32331c31865 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:37.940919 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-214f71d7-c38c-4fb6-afb9-d32331c31865 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 14 microversion: 2.20 time: 2.082322 Oct 12 04:17:37.941551 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 72/130] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:17:35 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 14 bytes in 2084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:37.946536 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-5fea14a5-223f-439d-9da2-882b6cab4e4b req-f9dfab4a-5f0c-452e-bcc3-b1858f714961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29fcfae4-9349-4167-9403-9a4a20f346bd", "tag": "c5a9a497-7d69-4ed5-85cb-fa9a1cc1b4bf"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:37.948040 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:17:37.948040 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:17:37.949745 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-33cf9070-f87f-4108-9cdb-a91529c29a5d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 14 microversion: 2.1 time: 3.177656 Oct 12 04:17:37.953058 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 59/131] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:17:34 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 14 bytes in 3180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 04:17:37.955535 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d940bfa1-c5ac-4067-8d60-b357a75268e2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:37.955665 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-5fea14a5-223f-439d-9da2-882b6cab4e4b req-f9dfab4a-5f0c-452e-bcc3-b1858f714961 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:37.956001 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-5fea14a5-223f-439d-9da2-882b6cab4e4b req-f9dfab4a-5f0c-452e-bcc3-b1858f714961 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:37.956282 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-d940bfa1-c5ac-4067-8d60-b357a75268e2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:37.962298 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d940bfa1-c5ac-4067-8d60-b357a75268e2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:37.962764 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d940bfa1-c5ac-4067-8d60-b357a75268e2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:37.963526 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d940bfa1-c5ac-4067-8d60-b357a75268e2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:37.963950 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d940bfa1-c5ac-4067-8d60-b357a75268e2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:37.966643 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-5fea14a5-223f-439d-9da2-882b6cab4e4b req-f9dfab4a-5f0c-452e-bcc3-b1858f714961 service nova] Creating event network-changed:c5a9a497-7d69-4ed5-85cb-fa9a1cc1b4bf for instance 29fcfae4-9349-4167-9403-9a4a20f346bd on hv-cinder-81306 Oct 12 04:17:37.971907 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-5fea14a5-223f-439d-9da2-882b6cab4e4b req-f9dfab4a-5f0c-452e-bcc3-b1858f714961 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029042 Oct 12 04:17:37.972663 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 73/132] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:17:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:17:38.159484 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-d940bfa1-c5ac-4067-8d60-b357a75268e2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:38.167183 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-d940bfa1-c5ac-4067-8d60-b357a75268e2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.215238 Oct 12 04:17:38.167838 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 60/133] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:37 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:38.952198 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-65ab9e5b-0040-4e54-b12a-c38ff0ec9af2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:38.953181 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-65ab9e5b-0040-4e54-b12a-c38ff0ec9af2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:38.959754 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-65ab9e5b-0040-4e54-b12a-c38ff0ec9af2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:38.960203 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-65ab9e5b-0040-4e54-b12a-c38ff0ec9af2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:38.960384 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-33d0def9-3fc8-4634-b825-8b83a6eb4c96 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:38.960958 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-65ab9e5b-0040-4e54-b12a-c38ff0ec9af2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:38.961321 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-33d0def9-3fc8-4634-b825-8b83a6eb4c96 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:38.961459 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-65ab9e5b-0040-4e54-b12a-c38ff0ec9af2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:38.967425 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-33d0def9-3fc8-4634-b825-8b83a6eb4c96 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:38.968370 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-33d0def9-3fc8-4634-b825-8b83a6eb4c96 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:38.969117 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-33d0def9-3fc8-4634-b825-8b83a6eb4c96 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:38.969538 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-33d0def9-3fc8-4634-b825-8b83a6eb4c96 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:41.809310 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-33d0def9-3fc8-4634-b825-8b83a6eb4c96 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 14 microversion: 2.1 time: 2.852244 Oct 12 04:17:41.812665 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 61/134] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:17:38 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 14 bytes in 2854 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 04:17:41.817489 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-911ed3bd-096d-44c4-b6c1-2b28eecdf3a5 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:41.817834 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-65ab9e5b-0040-4e54-b12a-c38ff0ec9af2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 14 microversion: 2.20 time: 2.869517 Oct 12 04:17:41.818456 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 74/135] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:17:38 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 14 bytes in 2871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:41.819273 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-911ed3bd-096d-44c4-b6c1-2b28eecdf3a5 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:41.826295 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-911ed3bd-096d-44c4-b6c1-2b28eecdf3a5 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:41.827406 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-911ed3bd-096d-44c4-b6c1-2b28eecdf3a5 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:41.828200 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-911ed3bd-096d-44c4-b6c1-2b28eecdf3a5 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:41.828923 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-911ed3bd-096d-44c4-b6c1-2b28eecdf3a5 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:41.952940 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-911ed3bd-096d-44c4-b6c1-2b28eecdf3a5 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:41.959981 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-911ed3bd-096d-44c4-b6c1-2b28eecdf3a5 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.148606 Oct 12 04:17:41.960534 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 62/136] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:41 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:42.820440 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-59ec6e58-9251-4f9e-adb9-767795abb079 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:42.821546 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-59ec6e58-9251-4f9e-adb9-767795abb079 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:42.828213 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-a3d6498b-7c16-4eaf-822b-a315e13e204a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:42.828663 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-59ec6e58-9251-4f9e-adb9-767795abb079 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:42.828812 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-59ec6e58-9251-4f9e-adb9-767795abb079 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:42.829120 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-a3d6498b-7c16-4eaf-822b-a315e13e204a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:42.829593 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-59ec6e58-9251-4f9e-adb9-767795abb079 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:42.830024 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-59ec6e58-9251-4f9e-adb9-767795abb079 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:42.835330 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a3d6498b-7c16-4eaf-822b-a315e13e204a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:42.835773 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a3d6498b-7c16-4eaf-822b-a315e13e204a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:42.837223 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a3d6498b-7c16-4eaf-822b-a315e13e204a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:42.837223 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a3d6498b-7c16-4eaf-822b-a315e13e204a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:45.683796 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-59ec6e58-9251-4f9e-adb9-767795abb079 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 14 microversion: 2.1 time: 2.867176 Oct 12 04:17:45.684508 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 75/137] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:17:42 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 14 bytes in 2869 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 04:17:45.692461 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-57023d5b-10be-4fea-96b2-76476161c0ae tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:45.693166 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-57023d5b-10be-4fea-96b2-76476161c0ae tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:45.695679 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-a3d6498b-7c16-4eaf-822b-a315e13e204a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 14 microversion: 2.20 time: 2.870950 Oct 12 04:17:45.697296 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 63/138] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:17:42 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 14 bytes in 2873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:45.699765 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-57023d5b-10be-4fea-96b2-76476161c0ae tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:45.700202 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-57023d5b-10be-4fea-96b2-76476161c0ae tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:45.701015 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-57023d5b-10be-4fea-96b2-76476161c0ae tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:45.701446 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-57023d5b-10be-4fea-96b2-76476161c0ae tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:45.822983 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-57023d5b-10be-4fea-96b2-76476161c0ae tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:45.830802 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-57023d5b-10be-4fea-96b2-76476161c0ae tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.144516 Oct 12 04:17:45.831350 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 76/139] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:45 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:46.634615 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-c8ffbac4-e5ce-4d3f-94d6-fa55cb89c6cb tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:46.635209 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-c8ffbac4-e5ce-4d3f-94d6-fa55cb89c6cb tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:46.644525 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c8ffbac4-e5ce-4d3f-94d6-fa55cb89c6cb tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:46.644525 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c8ffbac4-e5ce-4d3f-94d6-fa55cb89c6cb tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:46.644525 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c8ffbac4-e5ce-4d3f-94d6-fa55cb89c6cb tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:46.644525 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c8ffbac4-e5ce-4d3f-94d6-fa55cb89c6cb tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:46.671767 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-c8ffbac4-e5ce-4d3f-94d6-fa55cb89c6cb tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Going to try to terminate instance {{(pid=108898) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 04:17:46.695210 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-bbd0721d-9d4e-46cc-a6c9-582db21cc140 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:46.697045 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-bbd0721d-9d4e-46cc-a6c9-582db21cc140 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:46.704666 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bbd0721d-9d4e-46cc-a6c9-582db21cc140 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:46.705323 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bbd0721d-9d4e-46cc-a6c9-582db21cc140 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:46.706092 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bbd0721d-9d4e-46cc-a6c9-582db21cc140 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:46.706520 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bbd0721d-9d4e-46cc-a6c9-582db21cc140 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:46.780692 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-bbd0721d-9d4e-46cc-a6c9-582db21cc140 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 14 microversion: 2.1 time: 0.089108 Oct 12 04:17:46.783609 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 77/140] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:17:46 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 04:17:46.786422 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-02280eb4-287e-42a1-8485-685ad70b4c5b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:46.787438 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-02280eb4-287e-42a1-8485-685ad70b4c5b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:46.793791 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-02280eb4-287e-42a1-8485-685ad70b4c5b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:46.794236 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-02280eb4-287e-42a1-8485-685ad70b4c5b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:46.795019 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-02280eb4-287e-42a1-8485-685ad70b4c5b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:46.795444 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-02280eb4-287e-42a1-8485-685ad70b4c5b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:46.870689 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-02280eb4-287e-42a1-8485-685ad70b4c5b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 14 microversion: 2.20 time: 0.087842 Oct 12 04:17:46.871359 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 78/141] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:17:46 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:46.877095 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ff128825-5db3-46d6-b607-b8e380fd768f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:46.877785 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ff128825-5db3-46d6-b607-b8e380fd768f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:46.884375 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ff128825-5db3-46d6-b607-b8e380fd768f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:46.885012 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ff128825-5db3-46d6-b607-b8e380fd768f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:46.885995 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ff128825-5db3-46d6-b607-b8e380fd768f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:46.886484 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ff128825-5db3-46d6-b607-b8e380fd768f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:47.002250 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-c8ffbac4-e5ce-4d3f-94d6-fa55cb89c6cb tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "DELETE /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 204 len: 0 microversion: 2.1 time: 0.371519 Oct 12 04:17:47.003771 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 64/142] 10.222.0.21 () {58 vars in 1238 bytes} [Tue Oct 12 04:17:46 2021] DELETE /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 04:17:47.014657 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-b76e5836-cc90-493c-a185-2b0192a07e50 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:47.015378 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-b76e5836-cc90-493c-a185-2b0192a07e50 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:47.021241 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b76e5836-cc90-493c-a185-2b0192a07e50 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:47.021688 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b76e5836-cc90-493c-a185-2b0192a07e50 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:47.022451 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b76e5836-cc90-493c-a185-2b0192a07e50 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:47.022896 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b76e5836-cc90-493c-a185-2b0192a07e50 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:47.030318 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-ff128825-5db3-46d6-b607-b8e380fd768f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:47.037948 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ff128825-5db3-46d6-b607-b8e380fd768f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.165266 Oct 12 04:17:47.042710 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 79/143] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:46 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:47.146054 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-b76e5836-cc90-493c-a185-2b0192a07e50 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd523d965976493ba50e4154e90b123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7333a6b7535c4821b8eefd5dd71e4e6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:47.153704 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-b76e5836-cc90-493c-a185-2b0192a07e50 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 200 len: 1553 microversion: 2.1 time: 0.143028 Oct 12 04:17:47.154266 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 65/144] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:47 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 1553 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:47.791627 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-96b6f00d-8610-41b0-b0fa-5e1ef1cac57f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:47.792774 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-96b6f00d-8610-41b0-b0fa-5e1ef1cac57f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:47.799543 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-96b6f00d-8610-41b0-b0fa-5e1ef1cac57f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:47.799986 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-96b6f00d-8610-41b0-b0fa-5e1ef1cac57f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:47.800740 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-96b6f00d-8610-41b0-b0fa-5e1ef1cac57f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:47.801163 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-96b6f00d-8610-41b0-b0fa-5e1ef1cac57f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:47.880914 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-945ad04f-3c47-4421-b6f3-919a886c299e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:47.882194 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-96b6f00d-8610-41b0-b0fa-5e1ef1cac57f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 14 microversion: 2.1 time: 0.094060 Oct 12 04:17:47.882346 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-945ad04f-3c47-4421-b6f3-919a886c299e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:47.885453 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 80/145] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:17:47 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 04:17:47.904724 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-945ad04f-3c47-4421-b6f3-919a886c299e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:47.904724 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-945ad04f-3c47-4421-b6f3-919a886c299e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:47.904724 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-945ad04f-3c47-4421-b6f3-919a886c299e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:47.904724 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-945ad04f-3c47-4421-b6f3-919a886c299e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:47.988072 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-945ad04f-3c47-4421-b6f3-919a886c299e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 14 microversion: 2.20 time: 0.110704 Oct 12 04:17:47.988722 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 66/146] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:17:47 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:48.056629 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-36e850a1-a837-4178-844d-bea8ce84f678 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:48.057330 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-36e850a1-a837-4178-844d-bea8ce84f678 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:48.064691 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-36e850a1-a837-4178-844d-bea8ce84f678 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:48.065325 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-36e850a1-a837-4178-844d-bea8ce84f678 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:48.066520 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-36e850a1-a837-4178-844d-bea8ce84f678 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:48.067129 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-36e850a1-a837-4178-844d-bea8ce84f678 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:48.171098 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-196d75a4-16df-4690-8323-cd5eeb8aa6af tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:48.171796 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-196d75a4-16df-4690-8323-cd5eeb8aa6af tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:48.178247 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-196d75a4-16df-4690-8323-cd5eeb8aa6af tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:48.178793 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-196d75a4-16df-4690-8323-cd5eeb8aa6af tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:48.179571 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-196d75a4-16df-4690-8323-cd5eeb8aa6af tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:48.180003 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-196d75a4-16df-4690-8323-cd5eeb8aa6af tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:48.191880 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-36e850a1-a837-4178-844d-bea8ce84f678 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:48.205846 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-36e850a1-a837-4178-844d-bea8ce84f678 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.153412 Oct 12 04:17:48.206818 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 81/147] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:48 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:48.303333 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-196d75a4-16df-4690-8323-cd5eeb8aa6af tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd523d965976493ba50e4154e90b123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7333a6b7535c4821b8eefd5dd71e4e6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:48.311333 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-196d75a4-16df-4690-8323-cd5eeb8aa6af tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 200 len: 1553 microversion: 2.1 time: 0.144191 Oct 12 04:17:48.311933 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 67/148] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:48 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 1553 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:48.892247 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-80e41407-628b-4443-9997-0401a9dfd8bd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:48.893241 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-80e41407-628b-4443-9997-0401a9dfd8bd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:48.899425 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-80e41407-628b-4443-9997-0401a9dfd8bd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:48.899867 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-80e41407-628b-4443-9997-0401a9dfd8bd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:48.900626 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-80e41407-628b-4443-9997-0401a9dfd8bd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:48.901052 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-80e41407-628b-4443-9997-0401a9dfd8bd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:48.996091 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-80e41407-628b-4443-9997-0401a9dfd8bd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 14 microversion: 2.1 time: 0.107310 Oct 12 04:17:48.999185 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 82/149] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:17:48 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 04:17:48.999404 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-f44a8aa4-7e9f-41f0-b8e0-018e838d15c5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:48.999836 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-f44a8aa4-7e9f-41f0-b8e0-018e838d15c5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:49.006277 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f44a8aa4-7e9f-41f0-b8e0-018e838d15c5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:49.006753 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f44a8aa4-7e9f-41f0-b8e0-018e838d15c5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:49.007784 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f44a8aa4-7e9f-41f0-b8e0-018e838d15c5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:49.008207 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f44a8aa4-7e9f-41f0-b8e0-018e838d15c5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:49.103217 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-f44a8aa4-7e9f-41f0-b8e0-018e838d15c5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 14 microversion: 2.20 time: 0.107852 Oct 12 04:17:49.103841 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 68/150] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:17:48 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:49.225361 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-6e11c20e-ec5a-4138-a7cd-22a858e6d3e1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:49.226480 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-6e11c20e-ec5a-4138-a7cd-22a858e6d3e1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:49.232912 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6e11c20e-ec5a-4138-a7cd-22a858e6d3e1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:49.233355 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6e11c20e-ec5a-4138-a7cd-22a858e6d3e1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:49.234113 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6e11c20e-ec5a-4138-a7cd-22a858e6d3e1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:49.235389 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6e11c20e-ec5a-4138-a7cd-22a858e6d3e1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:49.328806 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-c46aaf36-d1ea-4e82-87d4-ed73cdc433f1 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:49.329503 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-c46aaf36-d1ea-4e82-87d4-ed73cdc433f1 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:49.336059 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c46aaf36-d1ea-4e82-87d4-ed73cdc433f1 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:49.336500 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c46aaf36-d1ea-4e82-87d4-ed73cdc433f1 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:49.337271 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c46aaf36-d1ea-4e82-87d4-ed73cdc433f1 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:49.337697 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c46aaf36-d1ea-4e82-87d4-ed73cdc433f1 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:49.361241 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-6e11c20e-ec5a-4138-a7cd-22a858e6d3e1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:49.368596 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-6e11c20e-ec5a-4138-a7cd-22a858e6d3e1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.147235 Oct 12 04:17:49.371403 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 83/151] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:49 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:49.487189 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c46aaf36-d1ea-4e82-87d4-ed73cdc433f1 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd523d965976493ba50e4154e90b123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7333a6b7535c4821b8eefd5dd71e4e6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:49.487189 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-c46aaf36-d1ea-4e82-87d4-ed73cdc433f1 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 200 len: 1553 microversion: 2.1 time: 0.149955 Oct 12 04:17:49.487189 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 69/152] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:49 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:50.008205 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-b6b70111-59ff-4497-a7fc-c1f30fef5b8b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:50.010136 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-b6b70111-59ff-4497-a7fc-c1f30fef5b8b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:50.018408 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b6b70111-59ff-4497-a7fc-c1f30fef5b8b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:50.019472 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b6b70111-59ff-4497-a7fc-c1f30fef5b8b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:50.020407 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b6b70111-59ff-4497-a7fc-c1f30fef5b8b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:50.021226 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b6b70111-59ff-4497-a7fc-c1f30fef5b8b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:50.109771 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-b6b70111-59ff-4497-a7fc-c1f30fef5b8b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 6314 microversion: 2.1 time: 0.106092 Oct 12 04:17:50.110768 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 84/153] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:17:50 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 6314 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:50.113984 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-a3afc703-1c17-4750-b458-178f7a0b994a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:50.114949 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-a3afc703-1c17-4750-b458-178f7a0b994a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:50.126050 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a3afc703-1c17-4750-b458-178f7a0b994a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:50.126050 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a3afc703-1c17-4750-b458-178f7a0b994a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:50.126050 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a3afc703-1c17-4750-b458-178f7a0b994a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:50.126050 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a3afc703-1c17-4750-b458-178f7a0b994a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:50.177141 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-f248a8ea-7834-4351-90e4-301287b1cfc3 req-d033d6de-9369-4231-9e47-cdfa97b6536f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61a95157-07b2-4d52-a3b5-51e526f99b31", "name": "network-vif-deleted", "tag": "45453f45-d5d3-4d04-be84-0088e8ca1bff"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:50.178608 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:17:50.178608 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:17:50.185956 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-f248a8ea-7834-4351-90e4-301287b1cfc3 req-d033d6de-9369-4231-9e47-cdfa97b6536f service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:50.192051 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-f248a8ea-7834-4351-90e4-301287b1cfc3 req-d033d6de-9369-4231-9e47-cdfa97b6536f service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:50.197457 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-f248a8ea-7834-4351-90e4-301287b1cfc3 req-d033d6de-9369-4231-9e47-cdfa97b6536f service nova] Creating event network-vif-deleted:45453f45-d5d3-4d04-be84-0088e8ca1bff for instance 61a95157-07b2-4d52-a3b5-51e526f99b31 on hv-cinder-81306 Oct 12 04:17:50.198561 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-a3afc703-1c17-4750-b458-178f7a0b994a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 14 microversion: 2.20 time: 0.088636 Oct 12 04:17:50.199357 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 70/154] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:17:50 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:50.202035 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-f248a8ea-7834-4351-90e4-301287b1cfc3 req-d033d6de-9369-4231-9e47-cdfa97b6536f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028808 Oct 12 04:17:50.202594 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 85/155] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:17:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:17:50.385744 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-5d9c6f71-98ab-4671-81b9-9c9476ee6008 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:50.386433 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-5d9c6f71-98ab-4671-81b9-9c9476ee6008 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:50.393045 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5d9c6f71-98ab-4671-81b9-9c9476ee6008 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:50.393479 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5d9c6f71-98ab-4671-81b9-9c9476ee6008 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:50.394234 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5d9c6f71-98ab-4671-81b9-9c9476ee6008 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:50.394657 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5d9c6f71-98ab-4671-81b9-9c9476ee6008 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:50.496638 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-bab5e3fd-debb-43fa-bac3-f380ea71e0d8 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:50.497335 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-bab5e3fd-debb-43fa-bac3-f380ea71e0d8 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:50.503850 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bab5e3fd-debb-43fa-bac3-f380ea71e0d8 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:50.504294 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bab5e3fd-debb-43fa-bac3-f380ea71e0d8 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:50.505053 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bab5e3fd-debb-43fa-bac3-f380ea71e0d8 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:50.505485 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bab5e3fd-debb-43fa-bac3-f380ea71e0d8 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:50.517617 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-5d9c6f71-98ab-4671-81b9-9c9476ee6008 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:50.524279 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-5d9c6f71-98ab-4671-81b9-9c9476ee6008 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.142502 Oct 12 04:17:50.524848 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 71/156] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:50 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:50.566483 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-bab5e3fd-debb-43fa-bac3-f380ea71e0d8 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd523d965976493ba50e4154e90b123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7333a6b7535c4821b8eefd5dd71e4e6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:50.574198 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-bab5e3fd-debb-43fa-bac3-f380ea71e0d8 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 200 len: 1346 microversion: 2.1 time: 0.081642 Oct 12 04:17:50.576827 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 86/157] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:50 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 1346 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:51.121497 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-efa74bc5-8aec-495c-84ae-f57e83237e24 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:51.122791 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-efa74bc5-8aec-495c-84ae-f57e83237e24 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:51.129565 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-efa74bc5-8aec-495c-84ae-f57e83237e24 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:51.130133 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-efa74bc5-8aec-495c-84ae-f57e83237e24 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:51.130980 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-efa74bc5-8aec-495c-84ae-f57e83237e24 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:51.131481 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-efa74bc5-8aec-495c-84ae-f57e83237e24 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:51.209565 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-2c85eec5-7c1c-4dc4-b152-06cd5c1bf898 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:51.210478 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-2c85eec5-7c1c-4dc4-b152-06cd5c1bf898 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:51.216683 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2c85eec5-7c1c-4dc4-b152-06cd5c1bf898 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:51.219463 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2c85eec5-7c1c-4dc4-b152-06cd5c1bf898 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:51.219463 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2c85eec5-7c1c-4dc4-b152-06cd5c1bf898 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:51.219463 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2c85eec5-7c1c-4dc4-b152-06cd5c1bf898 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:51.223372 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-efa74bc5-8aec-495c-84ae-f57e83237e24 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 9847 microversion: 2.1 time: 0.106179 Oct 12 04:17:51.227915 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 72/158] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:17:51 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 9847 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:51.307558 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-2c85eec5-7c1c-4dc4-b152-06cd5c1bf898 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 338 microversion: 2.20 time: 0.101501 Oct 12 04:17:51.308183 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 87/159] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:17:51 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 338 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:17:51.541917 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-08a264c4-06d5-483a-9a6e-1afe71d3fb1e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:51.542804 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-08a264c4-06d5-483a-9a6e-1afe71d3fb1e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:51.549375 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-08a264c4-06d5-483a-9a6e-1afe71d3fb1e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:51.549897 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-08a264c4-06d5-483a-9a6e-1afe71d3fb1e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:51.550818 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-08a264c4-06d5-483a-9a6e-1afe71d3fb1e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:51.551322 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-08a264c4-06d5-483a-9a6e-1afe71d3fb1e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:51.595665 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-0c890430-e6af-469a-b591-c89e1ec27436 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:51.596574 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-0c890430-e6af-469a-b591-c89e1ec27436 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:51.604535 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0c890430-e6af-469a-b591-c89e1ec27436 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:51.605866 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0c890430-e6af-469a-b591-c89e1ec27436 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:51.606820 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0c890430-e6af-469a-b591-c89e1ec27436 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:51.607396 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0c890430-e6af-469a-b591-c89e1ec27436 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:51.643680 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0c890430-e6af-469a-b591-c89e1ec27436 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:51.644300 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0c890430-e6af-469a-b591-c89e1ec27436 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:51.645030 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.objects.instance [None req-0c890430-e6af-469a-b591-c89e1ec27436 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lazy-loading 'fault' on Instance uuid 61a95157-07b2-4d52-a3b5-51e526f99b31 {{(pid=108897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:17:51.700013 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-0c890430-e6af-469a-b591-c89e1ec27436 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd523d965976493ba50e4154e90b123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7333a6b7535c4821b8eefd5dd71e4e6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:51.709713 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-0c890430-e6af-469a-b591-c89e1ec27436 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 200 len: 1351 microversion: 2.1 time: 0.118219 Oct 12 04:17:51.710294 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 88/160] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:51 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 1351 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:51.732170 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-08a264c4-06d5-483a-9a6e-1afe71d3fb1e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:51.741063 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-08a264c4-06d5-483a-9a6e-1afe71d3fb1e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.203585 Oct 12 04:17:51.744410 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 73/161] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:51 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:52.235760 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-7a38a99f-00f6-4d31-8a08-d785bb656b71 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:52.236673 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-7a38a99f-00f6-4d31-8a08-d785bb656b71 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:52.242438 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7a38a99f-00f6-4d31-8a08-d785bb656b71 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:52.242926 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7a38a99f-00f6-4d31-8a08-d785bb656b71 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:52.243698 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7a38a99f-00f6-4d31-8a08-d785bb656b71 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:52.244130 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7a38a99f-00f6-4d31-8a08-d785bb656b71 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:52.330568 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-135defbe-37c9-44ff-a382-84ce16465664 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:52.330568 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-135defbe-37c9-44ff-a382-84ce16465664 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:52.330568 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-135defbe-37c9-44ff-a382-84ce16465664 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:52.330568 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-135defbe-37c9-44ff-a382-84ce16465664 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:52.331122 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-135defbe-37c9-44ff-a382-84ce16465664 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:52.331122 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-135defbe-37c9-44ff-a382-84ce16465664 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:52.332099 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-7a38a99f-00f6-4d31-8a08-d785bb656b71 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 13651 microversion: 2.1 time: 0.100736 Oct 12 04:17:52.332736 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 89/162] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:17:52 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 13651 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:17:52.415849 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-135defbe-37c9-44ff-a382-84ce16465664 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 6964 microversion: 2.20 time: 0.100806 Oct 12 04:17:52.416505 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 74/163] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:17:52 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 6964 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:17:52.727177 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ca8e0535-b5c2-460d-aee4-5366d3e62627 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:52.727862 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ca8e0535-b5c2-460d-aee4-5366d3e62627 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:52.734474 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ca8e0535-b5c2-460d-aee4-5366d3e62627 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:52.734936 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ca8e0535-b5c2-460d-aee4-5366d3e62627 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:52.740553 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ca8e0535-b5c2-460d-aee4-5366d3e62627 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:52.740553 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ca8e0535-b5c2-460d-aee4-5366d3e62627 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:52.761259 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.wsgi [None req-ca8e0535-b5c2-460d-aee4-5366d3e62627 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] HTTP exception thrown: Instance 61a95157-07b2-4d52-a3b5-51e526f99b31 could not be found. Oct 12 04:17:52.761429 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-c26fefd6-709d-4be5-a862-b60a799cb124 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:52.761847 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ca8e0535-b5c2-460d-aee4-5366d3e62627 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Returning 404 to user: Instance 61a95157-07b2-4d52-a3b5-51e526f99b31 could not be found. {{(pid=108897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:17:52.762119 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-c26fefd6-709d-4be5-a862-b60a799cb124 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:52.762684 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ca8e0535-b5c2-460d-aee4-5366d3e62627 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 404 len: 111 microversion: 2.1 time: 0.039446 Oct 12 04:17:52.763393 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 90/164] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:52 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:17:52.771578 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c26fefd6-709d-4be5-a862-b60a799cb124 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:52.775396 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c26fefd6-709d-4be5-a862-b60a799cb124 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:52.775396 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c26fefd6-709d-4be5-a862-b60a799cb124 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:52.775396 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c26fefd6-709d-4be5-a862-b60a799cb124 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:52.915324 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c26fefd6-709d-4be5-a862-b60a799cb124 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:52.915324 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-c26fefd6-709d-4be5-a862-b60a799cb124 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.156919 Oct 12 04:17:52.915324 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 75/165] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:52 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:52.970801 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-244caf75-167a-4312-87ba-4d8cca1f99b0 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:52.971554 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-244caf75-167a-4312-87ba-4d8cca1f99b0 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:52.977352 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-244caf75-167a-4312-87ba-4d8cca1f99b0 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:52.977947 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-244caf75-167a-4312-87ba-4d8cca1f99b0 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:52.978734 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-244caf75-167a-4312-87ba-4d8cca1f99b0 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:52.979324 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-244caf75-167a-4312-87ba-4d8cca1f99b0 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:52.992119 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.wsgi [None req-244caf75-167a-4312-87ba-4d8cca1f99b0 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] HTTP exception thrown: Instance 61a95157-07b2-4d52-a3b5-51e526f99b31 could not be found. Oct 12 04:17:52.992706 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-244caf75-167a-4312-87ba-4d8cca1f99b0 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Returning 404 to user: Instance 61a95157-07b2-4d52-a3b5-51e526f99b31 could not be found. {{(pid=108897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:17:52.993552 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-244caf75-167a-4312-87ba-4d8cca1f99b0 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.026760 Oct 12 04:17:52.994200 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 91/166] 10.222.0.21 () {58 vars in 1301 bytes} [Tue Oct 12 04:17:52 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31/os-volume_attachments => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:17:53.343085 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-9cf9e0e5-b13d-4fe5-9cfb-3120d7274a7c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:53.343998 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-9cf9e0e5-b13d-4fe5-9cfb-3120d7274a7c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:53.349732 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9cf9e0e5-b13d-4fe5-9cfb-3120d7274a7c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:53.350180 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9cf9e0e5-b13d-4fe5-9cfb-3120d7274a7c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:53.350974 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9cf9e0e5-b13d-4fe5-9cfb-3120d7274a7c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:53.351408 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9cf9e0e5-b13d-4fe5-9cfb-3120d7274a7c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:53.427321 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-c6453553-18d5-4996-ab67-19343d8eb7de tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:53.428251 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-c6453553-18d5-4996-ab67-19343d8eb7de tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:53.433988 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c6453553-18d5-4996-ab67-19343d8eb7de tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:53.434427 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c6453553-18d5-4996-ab67-19343d8eb7de tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:53.435263 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c6453553-18d5-4996-ab67-19343d8eb7de tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:53.435690 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c6453553-18d5-4996-ab67-19343d8eb7de tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:53.442787 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-9cf9e0e5-b13d-4fe5-9cfb-3120d7274a7c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 16235 microversion: 2.1 time: 0.103207 Oct 12 04:17:53.444389 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 76/167] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:17:53 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 16235 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:17:53.524555 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-c6453553-18d5-4996-ab67-19343d8eb7de tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 10367 microversion: 2.20 time: 0.101146 Oct 12 04:17:53.527910 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 92/168] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:17:53 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 10367 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 04:17:53.931406 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-1ca78d92-034c-474a-8dc8-6eb8770b1e46 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:53.932250 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-1ca78d92-034c-474a-8dc8-6eb8770b1e46 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:53.938673 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1ca78d92-034c-474a-8dc8-6eb8770b1e46 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:53.939140 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1ca78d92-034c-474a-8dc8-6eb8770b1e46 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:53.939897 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1ca78d92-034c-474a-8dc8-6eb8770b1e46 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:53.940325 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1ca78d92-034c-474a-8dc8-6eb8770b1e46 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:54.070648 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-1ca78d92-034c-474a-8dc8-6eb8770b1e46 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:54.078283 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-1ca78d92-034c-474a-8dc8-6eb8770b1e46 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.150880 Oct 12 04:17:54.078864 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 77/169] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:53 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:54.455645 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-b4bc7b51-ecd0-4010-9232-038def2b2b67 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:54.456636 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-b4bc7b51-ecd0-4010-9232-038def2b2b67 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:54.463044 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b4bc7b51-ecd0-4010-9232-038def2b2b67 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:54.463495 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b4bc7b51-ecd0-4010-9232-038def2b2b67 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:54.464257 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b4bc7b51-ecd0-4010-9232-038def2b2b67 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:54.464687 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b4bc7b51-ecd0-4010-9232-038def2b2b67 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:54.535589 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-768fb06c-760a-4f4c-bf92-c2b5c1fdcc34 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:54.536485 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-768fb06c-760a-4f4c-bf92-c2b5c1fdcc34 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:54.542150 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-768fb06c-760a-4f4c-bf92-c2b5c1fdcc34 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:54.542590 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-768fb06c-760a-4f4c-bf92-c2b5c1fdcc34 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:54.543388 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-768fb06c-760a-4f4c-bf92-c2b5c1fdcc34 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:54.543809 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-768fb06c-760a-4f4c-bf92-c2b5c1fdcc34 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:54.566401 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-b4bc7b51-ecd0-4010-9232-038def2b2b67 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 17960 microversion: 2.1 time: 0.109460 Oct 12 04:17:54.568295 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 93/170] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:17:54 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 17960 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:17:54.664288 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-21e4b247-6782-40af-bd57-9a06bff9a6b2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1001224693", "imageRef": "bf8c5573-3890-45dc-aec8-b1ad89136f80", "flavorRef": "452", "networks": [{"uuid": "382ee370-8814-4057-bb86-a80b3c5a69fd"}]}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:54.673154 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-768fb06c-760a-4f4c-bf92-c2b5c1fdcc34 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 15025 microversion: 2.20 time: 0.136397 Oct 12 04:17:54.673154 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 78/171] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:17:54 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 15025 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 04:17:54.717296 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.network.neutron [None req-21e4b247-6782-40af-bd57-9a06bff9a6b2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] validate_networks() for [('382ee370-8814-4057-bb86-a80b3c5a69fd', None, None, None, None, None)] {{(pid=108897) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 04:17:54.901613 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-2e1f4523-e8b8-4a89-a1bb-77cc942a3af1 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:54.902464 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-2e1f4523-e8b8-4a89-a1bb-77cc942a3af1 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:54.913851 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2e1f4523-e8b8-4a89-a1bb-77cc942a3af1 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:54.914341 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2e1f4523-e8b8-4a89-a1bb-77cc942a3af1 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:54.915192 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2e1f4523-e8b8-4a89-a1bb-77cc942a3af1 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:54.915813 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2e1f4523-e8b8-4a89-a1bb-77cc942a3af1 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:54.933050 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.wsgi [None req-2e1f4523-e8b8-4a89-a1bb-77cc942a3af1 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] HTTP exception thrown: Instance 61a95157-07b2-4d52-a3b5-51e526f99b31 could not be found. Oct 12 04:17:54.933814 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-2e1f4523-e8b8-4a89-a1bb-77cc942a3af1 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Returning 404 to user: Instance 61a95157-07b2-4d52-a3b5-51e526f99b31 could not be found. {{(pid=108898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:17:54.934632 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-2e1f4523-e8b8-4a89-a1bb-77cc942a3af1 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "DELETE /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 404 len: 111 microversion: 2.1 time: 0.037737 Oct 12 04:17:54.935800 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 79/172] 10.222.0.21 () {58 vars in 1238 bytes} [Tue Oct 12 04:17:54 2021] DELETE /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 04:17:54.953259 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-4e5ffd53-5557-4447-bf6f-bebab6946f15 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:54.957343 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-4e5ffd53-5557-4447-bf6f-bebab6946f15 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] [instance: 61a95157-07b2-4d52-a3b5-51e526f99b31] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:54.960149 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4e5ffd53-5557-4447-bf6f-bebab6946f15 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:54.960597 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4e5ffd53-5557-4447-bf6f-bebab6946f15 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:54.961360 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4e5ffd53-5557-4447-bf6f-bebab6946f15 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:54.961789 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4e5ffd53-5557-4447-bf6f-bebab6946f15 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:54.975797 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.wsgi [None req-4e5ffd53-5557-4447-bf6f-bebab6946f15 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] HTTP exception thrown: Instance 61a95157-07b2-4d52-a3b5-51e526f99b31 could not be found. Oct 12 04:17:54.976379 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-4e5ffd53-5557-4447-bf6f-bebab6946f15 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] Returning 404 to user: Instance 61a95157-07b2-4d52-a3b5-51e526f99b31 could not be found. {{(pid=108898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:17:54.977189 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-4e5ffd53-5557-4447-bf6f-bebab6946f15 tempest-DeleteServersTestJSON-561885114 tempest-DeleteServersTestJSON-561885114-project] 10.222.0.21 "GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31" status: 404 len: 111 microversion: 2.1 time: 0.037199 Oct 12 04:17:54.977885 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 80/173] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:54 2021] GET /compute/v2.1/servers/61a95157-07b2-4d52-a3b5-51e526f99b31 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 04:17:55.094148 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-1e5b6095-b443-4556-ae74-26fb8867a55b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:55.095621 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-1e5b6095-b443-4556-ae74-26fb8867a55b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:55.102068 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1e5b6095-b443-4556-ae74-26fb8867a55b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:55.102510 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1e5b6095-b443-4556-ae74-26fb8867a55b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:55.103878 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1e5b6095-b443-4556-ae74-26fb8867a55b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:55.104726 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1e5b6095-b443-4556-ae74-26fb8867a55b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:55.183741 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-21e4b247-6782-40af-bd57-9a06bff9a6b2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Flavor limits 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 04:17:55.184141 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-21e4b247-6782-40af-bd57-9a06bff9a6b2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Image limits 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 04:17:55.184600 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-21e4b247-6782-40af-bd57-9a06bff9a6b2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Flavor pref 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 04:17:55.185008 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-21e4b247-6782-40af-bd57-9a06bff9a6b2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Image pref 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 04:17:55.185392 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-21e4b247-6782-40af-bd57-9a06bff9a6b2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 04:17:55.195332 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-21e4b247-6782-40af-bd57-9a06bff9a6b2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:55.195790 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-21e4b247-6782-40af-bd57-9a06bff9a6b2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:55.196723 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-21e4b247-6782-40af-bd57-9a06bff9a6b2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:55.197279 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-21e4b247-6782-40af-bd57-9a06bff9a6b2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:55.217207 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-21e4b247-6782-40af-bd57-9a06bff9a6b2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Getting quotas for project 15e19031226d475dbcf3cdfa50550ef4. Resources: {'cores', 'instances', 'ram'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:17:55.222350 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-21e4b247-6782-40af-bd57-9a06bff9a6b2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Getting quotas for user e56a34c8635a4d3385b0dc3f40f469bd and project 15e19031226d475dbcf3cdfa50550ef4. Resources: {'cores', 'instances', 'ram'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:17:55.240878 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-21e4b247-6782-40af-bd57-9a06bff9a6b2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Going to run 1 instances... {{(pid=108897) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 04:17:55.244378 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-21e4b247-6782-40af-bd57-9a06bff9a6b2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: ce6b1d1f-abeb-4ab7-a402-c003f0171210] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf8c5573-3890-45dc-aec8-b1ad89136f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 04:17:55.251137 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-1e5b6095-b443-4556-ae74-26fb8867a55b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:55.260936 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-1e5b6095-b443-4556-ae74-26fb8867a55b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.170325 Oct 12 04:17:55.271175 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 81/174] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:55 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:55.431642 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-21e4b247-6782-40af-bd57-9a06bff9a6b2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.771407 Oct 12 04:17:55.432401 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 94/175] 10.222.0.21 () {60 vars in 1146 bytes} [Tue Oct 12 04:17:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 04:17:55.442314 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-6d6db658-4eb6-414d-8535-a09e5764e588 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:55.443200 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-6d6db658-4eb6-414d-8535-a09e5764e588 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: ce6b1d1f-abeb-4ab7-a402-c003f0171210] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:55.580413 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-7b24220b-fa40-40a5-89a4-874784f96046 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:55.580413 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-7b24220b-fa40-40a5-89a4-874784f96046 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:55.581845 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7b24220b-fa40-40a5-89a4-874784f96046 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:55.582313 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7b24220b-fa40-40a5-89a4-874784f96046 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:55.583347 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7b24220b-fa40-40a5-89a4-874784f96046 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:55.583910 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7b24220b-fa40-40a5-89a4-874784f96046 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:55.688451 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-7b24220b-fa40-40a5-89a4-874784f96046 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 19342 microversion: 2.1 time: 0.118578 Oct 12 04:17:55.689755 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 95/176] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:17:55 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 19342 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 04:17:55.695321 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-618f0483-fc87-418a-823a-3e8720c363b6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:55.696514 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-618f0483-fc87-418a-823a-3e8720c363b6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:55.703905 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-618f0483-fc87-418a-823a-3e8720c363b6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:55.704592 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-618f0483-fc87-418a-823a-3e8720c363b6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:55.705370 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-618f0483-fc87-418a-823a-3e8720c363b6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:55.705814 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-618f0483-fc87-418a-823a-3e8720c363b6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:55.707634 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-6d6db658-4eb6-414d-8535-a09e5764e588 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:55.714717 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-6d6db658-4eb6-414d-8535-a09e5764e588 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210" status: 200 len: 1218 microversion: 2.1 time: 0.275975 Oct 12 04:17:55.715276 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 82/177] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:55 2021] GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210 => generated 1218 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:55.808768 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-618f0483-fc87-418a-823a-3e8720c363b6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 17931 microversion: 2.20 time: 0.117195 Oct 12 04:17:55.809891 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 96/178] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:17:55 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 17931 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:17:56.279552 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-f0232414-3494-482f-99f5-064c07dfc9be tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:56.280168 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-f0232414-3494-482f-99f5-064c07dfc9be tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:56.286622 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f0232414-3494-482f-99f5-064c07dfc9be tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:56.287165 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f0232414-3494-482f-99f5-064c07dfc9be tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:56.288008 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f0232414-3494-482f-99f5-064c07dfc9be tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:56.288370 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f0232414-3494-482f-99f5-064c07dfc9be tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:56.549078 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-f0232414-3494-482f-99f5-064c07dfc9be tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:56.556820 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-f0232414-3494-482f-99f5-064c07dfc9be tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.282141 Oct 12 04:17:56.568874 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 83/179] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:56 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:56.702973 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-7be6521c-62f0-4dc0-ab1c-b572fef1752b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:56.704718 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-7be6521c-62f0-4dc0-ab1c-b572fef1752b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:56.712473 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7be6521c-62f0-4dc0-ab1c-b572fef1752b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:56.712906 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7be6521c-62f0-4dc0-ab1c-b572fef1752b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:56.714372 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7be6521c-62f0-4dc0-ab1c-b572fef1752b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:56.715084 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7be6521c-62f0-4dc0-ab1c-b572fef1752b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:56.733354 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-54ccce78-bf39-4685-8c0a-065c7170479c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:56.740055 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-54ccce78-bf39-4685-8c0a-065c7170479c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: ce6b1d1f-abeb-4ab7-a402-c003f0171210] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:56.747354 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-54ccce78-bf39-4685-8c0a-065c7170479c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:56.747804 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-54ccce78-bf39-4685-8c0a-065c7170479c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:56.748579 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-54ccce78-bf39-4685-8c0a-065c7170479c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:56.749008 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-54ccce78-bf39-4685-8c0a-065c7170479c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:56.812297 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-7be6521c-62f0-4dc0-ab1c-b572fef1752b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 21104 microversion: 2.1 time: 0.113785 Oct 12 04:17:56.817830 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 97/180] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:17:56 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 21104 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:17:56.824113 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-c4acff7c-3345-459b-942b-07a99adb7590 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:56.834017 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-c4acff7c-3345-459b-942b-07a99adb7590 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:56.860439 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c4acff7c-3345-459b-942b-07a99adb7590 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:56.861304 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c4acff7c-3345-459b-942b-07a99adb7590 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:56.862115 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c4acff7c-3345-459b-942b-07a99adb7590 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:56.862548 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c4acff7c-3345-459b-942b-07a99adb7590 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:56.922129 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-54ccce78-bf39-4685-8c0a-065c7170479c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:56.933684 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-54ccce78-bf39-4685-8c0a-065c7170479c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210" status: 200 len: 1214 microversion: 2.1 time: 0.205282 Oct 12 04:17:56.935016 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 84/181] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:56 2021] GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210 => generated 1214 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:56.989744 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-c4acff7c-3345-459b-942b-07a99adb7590 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 18562 microversion: 2.20 time: 0.169937 Oct 12 04:17:56.990696 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 98/182] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:17:56 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 18562 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:17:57.577536 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-ad67017c-1897-409b-86f7-a8d6c59bcba4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:57.578893 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-ad67017c-1897-409b-86f7-a8d6c59bcba4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:57.585791 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ad67017c-1897-409b-86f7-a8d6c59bcba4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:57.586543 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ad67017c-1897-409b-86f7-a8d6c59bcba4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:57.587761 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ad67017c-1897-409b-86f7-a8d6c59bcba4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:57.588343 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ad67017c-1897-409b-86f7-a8d6c59bcba4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:57.739901 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-ad67017c-1897-409b-86f7-a8d6c59bcba4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:57.747395 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-ad67017c-1897-409b-86f7-a8d6c59bcba4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.177900 Oct 12 04:17:57.747952 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 85/183] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:57 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:17:57.832179 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-7d5c5cb2-ff5f-4784-9506-c40f07fd3670 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:57.832179 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-7d5c5cb2-ff5f-4784-9506-c40f07fd3670 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:57.833581 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7d5c5cb2-ff5f-4784-9506-c40f07fd3670 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:57.834050 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7d5c5cb2-ff5f-4784-9506-c40f07fd3670 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:57.834801 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7d5c5cb2-ff5f-4784-9506-c40f07fd3670 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:57.835235 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7d5c5cb2-ff5f-4784-9506-c40f07fd3670 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:57.951266 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-5f64e583-3bcc-48a9-ab21-db98c147c9dd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:17:57.952177 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-5f64e583-3bcc-48a9-ab21-db98c147c9dd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: ce6b1d1f-abeb-4ab7-a402-c003f0171210] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:57.958526 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5f64e583-3bcc-48a9-ab21-db98c147c9dd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:57.959593 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5f64e583-3bcc-48a9-ab21-db98c147c9dd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:57.962060 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5f64e583-3bcc-48a9-ab21-db98c147c9dd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:57.962060 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5f64e583-3bcc-48a9-ab21-db98c147c9dd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:58.025569 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-5f64e583-3bcc-48a9-ab21-db98c147c9dd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:17:58.034140 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-5f64e583-3bcc-48a9-ab21-db98c147c9dd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210" status: 200 len: 1278 microversion: 2.1 time: 0.086517 Oct 12 04:17:58.034900 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 86/184] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:17:57 2021] GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210 => generated 1278 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:17:58.039160 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-82d088ac-5986-485b-948e-4c7f3c6c231d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:17:58.040046 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-82d088ac-5986-485b-948e-4c7f3c6c231d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:17:58.049518 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-82d088ac-5986-485b-948e-4c7f3c6c231d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:58.049965 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-82d088ac-5986-485b-948e-4c7f3c6c231d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:17:58.050758 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-82d088ac-5986-485b-948e-4c7f3c6c231d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:17:58.051185 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-82d088ac-5986-485b-948e-4c7f3c6c231d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:00.738142 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-7d5c5cb2-ff5f-4784-9506-c40f07fd3670 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 23786 microversion: 2.1 time: 2.916475 Oct 12 04:18:00.738698 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 99/185] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:17:57 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 23786 bytes in 2918 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:18:00.743776 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-4d59f93f-812c-4882-8575-db5e1e74caaf tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:00.744465 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-4d59f93f-812c-4882-8575-db5e1e74caaf tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:00.750619 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4d59f93f-812c-4882-8575-db5e1e74caaf tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:00.751529 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4d59f93f-812c-4882-8575-db5e1e74caaf tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:00.752406 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4d59f93f-812c-4882-8575-db5e1e74caaf tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:00.752834 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4d59f93f-812c-4882-8575-db5e1e74caaf tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:00.761445 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-82d088ac-5986-485b-948e-4c7f3c6c231d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 22965 microversion: 2.20 time: 2.725444 Oct 12 04:18:00.762083 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 87/186] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:17:58 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 22965 bytes in 2727 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:18:00.769661 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-dbc13f40-6a46-4f87-a416-72da276388b9 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:00.772433 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-dbc13f40-6a46-4f87-a416-72da276388b9 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: ce6b1d1f-abeb-4ab7-a402-c003f0171210] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:00.781183 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-dbc13f40-6a46-4f87-a416-72da276388b9 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:00.781633 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-dbc13f40-6a46-4f87-a416-72da276388b9 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:00.782414 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-dbc13f40-6a46-4f87-a416-72da276388b9 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:00.782955 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-dbc13f40-6a46-4f87-a416-72da276388b9 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:01.097601 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-dbc13f40-6a46-4f87-a416-72da276388b9 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:01.105237 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-dbc13f40-6a46-4f87-a416-72da276388b9 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210" status: 200 len: 1278 microversion: 2.1 time: 0.341724 Oct 12 04:18:01.106649 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 88/187] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:00 2021] GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210 => generated 1278 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:01.222384 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-4d59f93f-812c-4882-8575-db5e1e74caaf tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:01.230726 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-4d59f93f-812c-4882-8575-db5e1e74caaf tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.490860 Oct 12 04:18:01.231908 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 100/188] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:00 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:01.638405 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-b6bfa3b3-a256-434b-8c8f-c316b4e0a13a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1715120873", "imageRef": "bf8c5573-3890-45dc-aec8-b1ad89136f80", "flavorRef": "452", "networks": [{"uuid": "6b995d32-bc3e-445e-a9d2-65b2ff724c69"}]}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:01.698890 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.network.neutron [None req-b6bfa3b3-a256-434b-8c8f-c316b4e0a13a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] validate_networks() for [('6b995d32-bc3e-445e-a9d2-65b2ff724c69', None, None, None, None, None)] {{(pid=108898) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 04:18:01.749926 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-f64a02eb-b4d5-4064-8ea4-20a845eb6bfe tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:01.751511 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-f64a02eb-b4d5-4064-8ea4-20a845eb6bfe tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:01.761187 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f64a02eb-b4d5-4064-8ea4-20a845eb6bfe tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:01.762505 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f64a02eb-b4d5-4064-8ea4-20a845eb6bfe tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:01.764002 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f64a02eb-b4d5-4064-8ea4-20a845eb6bfe tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:01.764919 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f64a02eb-b4d5-4064-8ea4-20a845eb6bfe tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:01.899226 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-f64a02eb-b4d5-4064-8ea4-20a845eb6bfe tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 24164 microversion: 2.1 time: 0.152143 Oct 12 04:18:01.900866 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 101/189] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:01 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 24164 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:18:01.905344 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-c7eb2ec6-1ed0-4349-8534-cadf7608e5ee tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:01.906392 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-c7eb2ec6-1ed0-4349-8534-cadf7608e5ee tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:01.913467 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c7eb2ec6-1ed0-4349-8534-cadf7608e5ee tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:01.913973 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c7eb2ec6-1ed0-4349-8534-cadf7608e5ee tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:01.914861 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c7eb2ec6-1ed0-4349-8534-cadf7608e5ee tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:01.915477 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c7eb2ec6-1ed0-4349-8534-cadf7608e5ee tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:02.007465 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-c7eb2ec6-1ed0-4349-8534-cadf7608e5ee tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 23786 microversion: 2.20 time: 0.106158 Oct 12 04:18:02.015320 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 102/190] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:01 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 23786 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:18:02.123679 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-c5902766-07ba-4bfb-a176-117cb39ca71c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:02.124382 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-c5902766-07ba-4bfb-a176-117cb39ca71c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: ce6b1d1f-abeb-4ab7-a402-c003f0171210] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:02.132345 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c5902766-07ba-4bfb-a176-117cb39ca71c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:02.134240 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c5902766-07ba-4bfb-a176-117cb39ca71c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:02.134240 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c5902766-07ba-4bfb-a176-117cb39ca71c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:02.134411 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c5902766-07ba-4bfb-a176-117cb39ca71c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:02.415809 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-c5902766-07ba-4bfb-a176-117cb39ca71c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:02.424246 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-c5902766-07ba-4bfb-a176-117cb39ca71c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210" status: 200 len: 1318 microversion: 2.1 time: 0.304354 Oct 12 04:18:02.424804 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 103/191] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:02 2021] GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210 => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:02.436568 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-b6bfa3b3-a256-434b-8c8f-c316b4e0a13a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Flavor limits 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 04:18:02.436987 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-b6bfa3b3-a256-434b-8c8f-c316b4e0a13a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Image limits 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 04:18:02.437091 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-b6bfa3b3-a256-434b-8c8f-c316b4e0a13a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Flavor pref 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 04:18:02.437332 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-624a3560-0c12-47b6-9231-04567577a4a8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:02.437687 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-b6bfa3b3-a256-434b-8c8f-c316b4e0a13a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Image pref 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 04:18:02.437942 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-624a3560-0c12-47b6-9231-04567577a4a8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:02.438169 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-b6bfa3b3-a256-434b-8c8f-c316b4e0a13a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 04:18:02.444238 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-624a3560-0c12-47b6-9231-04567577a4a8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:02.444682 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-624a3560-0c12-47b6-9231-04567577a4a8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:02.445520 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-624a3560-0c12-47b6-9231-04567577a4a8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:02.445857 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-624a3560-0c12-47b6-9231-04567577a4a8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:02.449905 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b6bfa3b3-a256-434b-8c8f-c316b4e0a13a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:02.450982 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b6bfa3b3-a256-434b-8c8f-c316b4e0a13a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:02.452087 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b6bfa3b3-a256-434b-8c8f-c316b4e0a13a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:02.452623 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b6bfa3b3-a256-434b-8c8f-c316b4e0a13a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:02.472468 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-b6bfa3b3-a256-434b-8c8f-c316b4e0a13a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Getting quotas for project 9e7c44417ccc40b9aa1c0a343debf9df. Resources: {'cores', 'instances', 'ram'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:18:02.477292 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-b6bfa3b3-a256-434b-8c8f-c316b4e0a13a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Getting quotas for user af792a61698f4b0180f7596f9497d5ca and project 9e7c44417ccc40b9aa1c0a343debf9df. Resources: {'cores', 'instances', 'ram'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:18:02.490464 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-b6bfa3b3-a256-434b-8c8f-c316b4e0a13a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Going to run 1 instances... {{(pid=108898) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 04:18:02.493050 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-b6bfa3b3-a256-434b-8c8f-c316b4e0a13a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: 1486eeab-56a9-4167-a787-47d83d4aef54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf8c5573-3890-45dc-aec8-b1ad89136f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108898) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 04:18:02.593271 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-b6bfa3b3-a256-434b-8c8f-c316b4e0a13a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.958641 Oct 12 04:18:02.594223 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 89/192] 10.222.0.21 () {60 vars in 1146 bytes} [Tue Oct 12 04:18:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 04:18:02.605313 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-066f518e-fd05-43bd-8afb-b716a9bf1e13 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:02.606499 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-066f518e-fd05-43bd-8afb-b716a9bf1e13 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: 1486eeab-56a9-4167-a787-47d83d4aef54] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:02.692169 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-066f518e-fd05-43bd-8afb-b716a9bf1e13 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:02.696394 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-624a3560-0c12-47b6-9231-04567577a4a8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:02.703139 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-066f518e-fd05-43bd-8afb-b716a9bf1e13 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54" status: 200 len: 1214 microversion: 2.1 time: 0.102255 Oct 12 04:18:02.704106 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 90/193] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:02 2021] GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54 => generated 1214 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:02.707963 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-624a3560-0c12-47b6-9231-04567577a4a8 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.281852 Oct 12 04:18:02.708887 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 104/194] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:02 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:02.912057 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-2554c404-5268-494b-8fe8-c34cd7d8e366 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:02.913223 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-2554c404-5268-494b-8fe8-c34cd7d8e366 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:02.919435 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2554c404-5268-494b-8fe8-c34cd7d8e366 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:02.919871 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2554c404-5268-494b-8fe8-c34cd7d8e366 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:02.920623 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2554c404-5268-494b-8fe8-c34cd7d8e366 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:02.921045 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2554c404-5268-494b-8fe8-c34cd7d8e366 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:03.004555 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-2554c404-5268-494b-8fe8-c34cd7d8e366 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 25046 microversion: 2.1 time: 0.096554 Oct 12 04:18:03.006079 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 91/195] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:02 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 25046 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:18:03.025040 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-b67e49ce-5875-416e-87b3-be017abc3179 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:03.026158 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-b67e49ce-5875-416e-87b3-be017abc3179 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:03.035490 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b67e49ce-5875-416e-87b3-be017abc3179 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:03.035626 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b67e49ce-5875-416e-87b3-be017abc3179 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:03.036430 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b67e49ce-5875-416e-87b3-be017abc3179 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:03.036852 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b67e49ce-5875-416e-87b3-be017abc3179 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:03.179056 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-b67e49ce-5875-416e-87b3-be017abc3179 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 24616 microversion: 2.20 time: 0.157507 Oct 12 04:18:03.184271 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 105/196] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:03 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 24616 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:18:03.384608 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-cd6f7a7a-7373-40f1-8580-ff9e68212ef7 req-b702cd4f-aa55-41b3-a632-8d2baf0b1b5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce6b1d1f-abeb-4ab7-a402-c003f0171210", "tag": "6fdf3f9d-d5b4-4906-8160-05e737485cfe"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:03.386262 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:18:03.386262 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:18:03.394497 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-cd6f7a7a-7373-40f1-8580-ff9e68212ef7 req-b702cd4f-aa55-41b3-a632-8d2baf0b1b5e service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:03.394962 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-cd6f7a7a-7373-40f1-8580-ff9e68212ef7 req-b702cd4f-aa55-41b3-a632-8d2baf0b1b5e service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:03.406821 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-cd6f7a7a-7373-40f1-8580-ff9e68212ef7 req-b702cd4f-aa55-41b3-a632-8d2baf0b1b5e service nova] Creating event network-changed:6fdf3f9d-d5b4-4906-8160-05e737485cfe for instance ce6b1d1f-abeb-4ab7-a402-c003f0171210 on hv-cinder-81306 Oct 12 04:18:03.414922 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-cd6f7a7a-7373-40f1-8580-ff9e68212ef7 req-b702cd4f-aa55-41b3-a632-8d2baf0b1b5e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033894 Oct 12 04:18:03.430625 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 92/197] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:18:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:18:03.444977 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-6f5b41fd-4648-4fa4-a408-377d7611d21c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:03.445672 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-6f5b41fd-4648-4fa4-a408-377d7611d21c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: ce6b1d1f-abeb-4ab7-a402-c003f0171210] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:03.455381 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6f5b41fd-4648-4fa4-a408-377d7611d21c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:03.458936 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6f5b41fd-4648-4fa4-a408-377d7611d21c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:03.458936 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6f5b41fd-4648-4fa4-a408-377d7611d21c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:03.458936 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6f5b41fd-4648-4fa4-a408-377d7611d21c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:03.657820 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-6f5b41fd-4648-4fa4-a408-377d7611d21c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:03.666861 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-6f5b41fd-4648-4fa4-a408-377d7611d21c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210" status: 200 len: 1318 microversion: 2.1 time: 0.225865 Oct 12 04:18:03.667756 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 106/198] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:03 2021] GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:03.720706 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-7dd1ec94-abac-4749-a147-708866f2e3ae tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:03.721719 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-7dd1ec94-abac-4749-a147-708866f2e3ae tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: 1486eeab-56a9-4167-a787-47d83d4aef54] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:03.732326 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-795333cd-cf42-4c4a-8ab0-ecc7220de044 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:03.732961 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-795333cd-cf42-4c4a-8ab0-ecc7220de044 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:03.742097 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-795333cd-cf42-4c4a-8ab0-ecc7220de044 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:03.742957 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7dd1ec94-abac-4749-a147-708866f2e3ae tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:03.743378 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-795333cd-cf42-4c4a-8ab0-ecc7220de044 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:03.744083 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7dd1ec94-abac-4749-a147-708866f2e3ae tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:03.745744 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7dd1ec94-abac-4749-a147-708866f2e3ae tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:03.746323 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-795333cd-cf42-4c4a-8ab0-ecc7220de044 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:03.747230 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-795333cd-cf42-4c4a-8ab0-ecc7220de044 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:03.748485 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7dd1ec94-abac-4749-a147-708866f2e3ae tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:03.842882 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-7dd1ec94-abac-4749-a147-708866f2e3ae tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:03.855952 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-7dd1ec94-abac-4749-a147-708866f2e3ae tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54" status: 200 len: 1218 microversion: 2.1 time: 0.139127 Oct 12 04:18:03.856526 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 93/199] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:03 2021] GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54 => generated 1218 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:03.982875 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-795333cd-cf42-4c4a-8ab0-ecc7220de044 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:03.992393 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-795333cd-cf42-4c4a-8ab0-ecc7220de044 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.263879 Oct 12 04:18:03.993792 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 107/200] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:03 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:04.021770 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-f4b95382-2e12-42a7-b3ee-72652384a2fd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:04.022713 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-f4b95382-2e12-42a7-b3ee-72652384a2fd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:04.029313 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f4b95382-2e12-42a7-b3ee-72652384a2fd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:04.030020 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f4b95382-2e12-42a7-b3ee-72652384a2fd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:04.030996 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f4b95382-2e12-42a7-b3ee-72652384a2fd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:04.031590 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f4b95382-2e12-42a7-b3ee-72652384a2fd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:04.126300 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-f4b95382-2e12-42a7-b3ee-72652384a2fd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 25817 microversion: 2.1 time: 0.108249 Oct 12 04:18:04.127008 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 94/201] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:04 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 25817 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 04:18:04.191863 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-0df559f1-d31e-4b40-a876-d015137d0b12 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:04.193012 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-0df559f1-d31e-4b40-a876-d015137d0b12 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:04.199565 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0df559f1-d31e-4b40-a876-d015137d0b12 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:04.203329 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0df559f1-d31e-4b40-a876-d015137d0b12 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:04.203329 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0df559f1-d31e-4b40-a876-d015137d0b12 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:04.203329 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0df559f1-d31e-4b40-a876-d015137d0b12 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:04.299840 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-0df559f1-d31e-4b40-a876-d015137d0b12 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 25548 microversion: 2.20 time: 0.111819 Oct 12 04:18:04.300721 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 108/202] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:04 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 25548 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:18:04.685345 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-155df1e9-b895-448a-9c22-7bc9dbf51ee8 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:04.686312 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-155df1e9-b895-448a-9c22-7bc9dbf51ee8 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: ce6b1d1f-abeb-4ab7-a402-c003f0171210] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:04.694014 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-155df1e9-b895-448a-9c22-7bc9dbf51ee8 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:04.694460 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-155df1e9-b895-448a-9c22-7bc9dbf51ee8 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:04.695258 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-155df1e9-b895-448a-9c22-7bc9dbf51ee8 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:04.695681 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-155df1e9-b895-448a-9c22-7bc9dbf51ee8 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:04.833108 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-155df1e9-b895-448a-9c22-7bc9dbf51ee8 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:04.843384 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-155df1e9-b895-448a-9c22-7bc9dbf51ee8 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210" status: 200 len: 1318 microversion: 2.1 time: 0.162662 Oct 12 04:18:04.851248 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 95/203] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:04 2021] GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:04.873727 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-2f31ca77-3b62-4bee-a048-0638e651911a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:04.874734 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-2f31ca77-3b62-4bee-a048-0638e651911a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: 1486eeab-56a9-4167-a787-47d83d4aef54] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:04.881652 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2f31ca77-3b62-4bee-a048-0638e651911a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:04.882090 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2f31ca77-3b62-4bee-a048-0638e651911a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:04.882951 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2f31ca77-3b62-4bee-a048-0638e651911a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:04.883378 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2f31ca77-3b62-4bee-a048-0638e651911a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:04.949436 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-2f31ca77-3b62-4bee-a048-0638e651911a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:04.958555 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-2f31ca77-3b62-4bee-a048-0638e651911a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54" status: 200 len: 1266 microversion: 2.1 time: 0.088912 Oct 12 04:18:04.968474 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 109/204] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:04 2021] GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:05.010583 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-0426c6f3-ed53-4dc1-b24d-abfe7ddc08a4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:05.011258 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-0426c6f3-ed53-4dc1-b24d-abfe7ddc08a4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:05.016877 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0426c6f3-ed53-4dc1-b24d-abfe7ddc08a4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:05.017886 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0426c6f3-ed53-4dc1-b24d-abfe7ddc08a4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:05.018649 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0426c6f3-ed53-4dc1-b24d-abfe7ddc08a4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:05.019108 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0426c6f3-ed53-4dc1-b24d-abfe7ddc08a4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:05.143729 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-a37a153d-b145-428c-beb1-87bc5a7211b5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:05.143729 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-a37a153d-b145-428c-beb1-87bc5a7211b5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:05.149148 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-0426c6f3-ed53-4dc1-b24d-abfe7ddc08a4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:05.157359 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a37a153d-b145-428c-beb1-87bc5a7211b5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:05.157865 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a37a153d-b145-428c-beb1-87bc5a7211b5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:05.159805 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a37a153d-b145-428c-beb1-87bc5a7211b5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:05.163203 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-0426c6f3-ed53-4dc1-b24d-abfe7ddc08a4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.156178 Oct 12 04:18:05.163359 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a37a153d-b145-428c-beb1-87bc5a7211b5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:05.164065 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 96/205] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:05 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:05.279487 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-a37a153d-b145-428c-beb1-87bc5a7211b5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 26498 microversion: 2.1 time: 0.132155 Oct 12 04:18:05.279487 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 110/206] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:05 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 26498 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:18:05.313054 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-072f064e-3bd3-43f5-b49e-345c00d5730e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:05.314026 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-072f064e-3bd3-43f5-b49e-345c00d5730e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:05.337192 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-072f064e-3bd3-43f5-b49e-345c00d5730e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:05.337641 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-072f064e-3bd3-43f5-b49e-345c00d5730e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:05.338420 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-072f064e-3bd3-43f5-b49e-345c00d5730e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:05.338879 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-072f064e-3bd3-43f5-b49e-345c00d5730e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:05.467667 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-072f064e-3bd3-43f5-b49e-345c00d5730e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 26105 microversion: 2.20 time: 0.159388 Oct 12 04:18:05.470708 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 97/207] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:05 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 26105 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:18:05.863581 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-5f97d46d-5fc9-4fb2-9e08-6e20f5b6d45a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:05.893025 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-5f97d46d-5fc9-4fb2-9e08-6e20f5b6d45a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: ce6b1d1f-abeb-4ab7-a402-c003f0171210] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:05.893025 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5f97d46d-5fc9-4fb2-9e08-6e20f5b6d45a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:05.893025 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5f97d46d-5fc9-4fb2-9e08-6e20f5b6d45a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:05.893025 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5f97d46d-5fc9-4fb2-9e08-6e20f5b6d45a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:05.894150 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5f97d46d-5fc9-4fb2-9e08-6e20f5b6d45a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:05.977615 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-177b3d7e-a50a-4fbf-ba88-cc43a862d9f6 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:05.978315 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-177b3d7e-a50a-4fbf-ba88-cc43a862d9f6 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: 1486eeab-56a9-4167-a787-47d83d4aef54] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:05.986915 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-177b3d7e-a50a-4fbf-ba88-cc43a862d9f6 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:05.987825 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-177b3d7e-a50a-4fbf-ba88-cc43a862d9f6 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:05.988810 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-177b3d7e-a50a-4fbf-ba88-cc43a862d9f6 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:05.989240 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-177b3d7e-a50a-4fbf-ba88-cc43a862d9f6 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:06.064908 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-177b3d7e-a50a-4fbf-ba88-cc43a862d9f6 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:06.072503 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-177b3d7e-a50a-4fbf-ba88-cc43a862d9f6 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54" status: 200 len: 1272 microversion: 2.1 time: 0.099370 Oct 12 04:18:06.073263 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 98/208] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:05 2021] GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54 => generated 1272 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:06.075602 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-5f97d46d-5fc9-4fb2-9e08-6e20f5b6d45a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:06.084148 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-5f97d46d-5fc9-4fb2-9e08-6e20f5b6d45a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210" status: 200 len: 1318 microversion: 2.1 time: 0.225658 Oct 12 04:18:06.084767 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 111/209] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:05 2021] GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:06.186625 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-3d36d9bf-a586-4689-8f66-a4e23a0645ff tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:06.187500 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-3d36d9bf-a586-4689-8f66-a4e23a0645ff tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:06.195211 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3d36d9bf-a586-4689-8f66-a4e23a0645ff tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:06.196677 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3d36d9bf-a586-4689-8f66-a4e23a0645ff tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:06.197455 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3d36d9bf-a586-4689-8f66-a4e23a0645ff tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:06.197876 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3d36d9bf-a586-4689-8f66-a4e23a0645ff tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:06.290206 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-7d6324dc-4061-4f8a-b111-e14997ce470f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:06.291353 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-7d6324dc-4061-4f8a-b111-e14997ce470f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:06.310274 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7d6324dc-4061-4f8a-b111-e14997ce470f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:06.311070 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7d6324dc-4061-4f8a-b111-e14997ce470f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:06.311959 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7d6324dc-4061-4f8a-b111-e14997ce470f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:06.312658 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7d6324dc-4061-4f8a-b111-e14997ce470f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:06.369801 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-3d36d9bf-a586-4689-8f66-a4e23a0645ff tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:06.377570 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-3d36d9bf-a586-4689-8f66-a4e23a0645ff tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.195864 Oct 12 04:18:06.378136 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 99/210] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:06 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:06.419264 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-7d6324dc-4061-4f8a-b111-e14997ce470f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 27053 microversion: 2.1 time: 0.133038 Oct 12 04:18:06.421571 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 112/211] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:06 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 27053 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:18:06.478567 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-e74940a4-46e6-4e8e-8c62-8bb95d12e0c0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:06.479513 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-e74940a4-46e6-4e8e-8c62-8bb95d12e0c0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:06.489906 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e74940a4-46e6-4e8e-8c62-8bb95d12e0c0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:06.490360 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e74940a4-46e6-4e8e-8c62-8bb95d12e0c0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:06.491203 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e74940a4-46e6-4e8e-8c62-8bb95d12e0c0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:06.491606 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e74940a4-46e6-4e8e-8c62-8bb95d12e0c0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:06.632086 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-e74940a4-46e6-4e8e-8c62-8bb95d12e0c0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 26797 microversion: 2.20 time: 0.156934 Oct 12 04:18:06.633813 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 100/212] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:06 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 26797 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:18:07.090259 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-92e60f5a-c8c6-4ce4-b8b8-8773f1ad321c tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:07.091126 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-92e60f5a-c8c6-4ce4-b8b8-8773f1ad321c tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: 1486eeab-56a9-4167-a787-47d83d4aef54] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:07.103919 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-68b88cee-0e2b-43c2-a643-3af6e9366669 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:07.105380 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-68b88cee-0e2b-43c2-a643-3af6e9366669 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: ce6b1d1f-abeb-4ab7-a402-c003f0171210] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:07.115605 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-92e60f5a-c8c6-4ce4-b8b8-8773f1ad321c tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:07.116048 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-92e60f5a-c8c6-4ce4-b8b8-8773f1ad321c tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:07.116863 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-68b88cee-0e2b-43c2-a643-3af6e9366669 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:07.117519 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-68b88cee-0e2b-43c2-a643-3af6e9366669 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:07.118398 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-68b88cee-0e2b-43c2-a643-3af6e9366669 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:07.119539 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-68b88cee-0e2b-43c2-a643-3af6e9366669 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:07.119659 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-92e60f5a-c8c6-4ce4-b8b8-8773f1ad321c tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:07.125246 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-92e60f5a-c8c6-4ce4-b8b8-8773f1ad321c tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:07.677475 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-68b88cee-0e2b-43c2-a643-3af6e9366669 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:07.685904 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-68b88cee-0e2b-43c2-a643-3af6e9366669 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210" status: 200 len: 1318 microversion: 2.1 time: 0.587869 Oct 12 04:18:07.686614 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 101/213] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:07 2021] GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210 => generated 1318 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:07.691250 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d0a6e70b-9890-4aec-a274-55932955d876 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:07.692278 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-d0a6e70b-9890-4aec-a274-55932955d876 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:07.698344 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d0a6e70b-9890-4aec-a274-55932955d876 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:07.699993 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d0a6e70b-9890-4aec-a274-55932955d876 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:07.699993 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d0a6e70b-9890-4aec-a274-55932955d876 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:07.700353 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d0a6e70b-9890-4aec-a274-55932955d876 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:07.717038 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-92e60f5a-c8c6-4ce4-b8b8-8773f1ad321c tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:07.725320 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-92e60f5a-c8c6-4ce4-b8b8-8773f1ad321c tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54" status: 200 len: 1314 microversion: 2.1 time: 0.639220 Oct 12 04:18:07.725882 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 113/214] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:07 2021] GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54 => generated 1314 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:07.731646 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-90f75cf5-c8c4-4270-ba97-edd57b630863 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:07.732919 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-90f75cf5-c8c4-4270-ba97-edd57b630863 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:07.739361 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-90f75cf5-c8c4-4270-ba97-edd57b630863 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:07.739800 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-90f75cf5-c8c4-4270-ba97-edd57b630863 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:07.740686 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-90f75cf5-c8c4-4270-ba97-edd57b630863 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:07.741109 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-90f75cf5-c8c4-4270-ba97-edd57b630863 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:07.939794 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-d0a6e70b-9890-4aec-a274-55932955d876 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:07.953897 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-d0a6e70b-9890-4aec-a274-55932955d876 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.265998 Oct 12 04:18:07.955290 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 102/215] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:07 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:07.981244 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-a47eb81a-9f59-46b0-aac6-12c36c165d0a req-8bf51da1-d6cf-4780-90a5-a2f486028d8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1486eeab-56a9-4167-a787-47d83d4aef54", "tag": "fc902d68-62aa-4b28-8d19-1157b9714bdd"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:07.983382 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:18:07.983382 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:18:07.993152 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-a47eb81a-9f59-46b0-aac6-12c36c165d0a req-8bf51da1-d6cf-4780-90a5-a2f486028d8d service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:07.993856 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-a47eb81a-9f59-46b0-aac6-12c36c165d0a req-8bf51da1-d6cf-4780-90a5-a2f486028d8d service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:08.011759 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-a47eb81a-9f59-46b0-aac6-12c36c165d0a req-8bf51da1-d6cf-4780-90a5-a2f486028d8d service nova] Creating event network-changed:fc902d68-62aa-4b28-8d19-1157b9714bdd for instance 1486eeab-56a9-4167-a787-47d83d4aef54 on hv-cinder-81306 Oct 12 04:18:08.025106 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-a47eb81a-9f59-46b0-aac6-12c36c165d0a req-8bf51da1-d6cf-4780-90a5-a2f486028d8d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059080 Oct 12 04:18:08.027480 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 103/216] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:18:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:18:08.036651 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-ce5285b7-108b-4ddc-a819-c64548d61bff tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:08.038514 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-ce5285b7-108b-4ddc-a819-c64548d61bff tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:08.045003 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ce5285b7-108b-4ddc-a819-c64548d61bff tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:08.045352 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ce5285b7-108b-4ddc-a819-c64548d61bff tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:08.046172 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ce5285b7-108b-4ddc-a819-c64548d61bff tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:08.046608 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ce5285b7-108b-4ddc-a819-c64548d61bff tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:08.084333 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-90f75cf5-c8c4-4270-ba97-edd57b630863 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 27562 microversion: 2.1 time: 0.357012 Oct 12 04:18:08.085216 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 114/217] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:07 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 27562 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:18:08.151225 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-ce5285b7-108b-4ddc-a819-c64548d61bff tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 27394 microversion: 2.20 time: 0.121981 Oct 12 04:18:08.153088 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 104/218] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:08 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 27394 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:18:08.653651 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-5dae3641-b0b3-4659-8d19-5f69a3e1e05c req-178e11f5-f4d5-44e5-999e-109e72323308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce6b1d1f-abeb-4ab7-a402-c003f0171210", "name": "network-vif-plugged", "status": "completed", "tag": "6fdf3f9d-d5b4-4906-8160-05e737485cfe"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:08.655184 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:18:08.655184 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:18:08.662811 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-5dae3641-b0b3-4659-8d19-5f69a3e1e05c req-178e11f5-f4d5-44e5-999e-109e72323308 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:08.663468 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-5dae3641-b0b3-4659-8d19-5f69a3e1e05c req-178e11f5-f4d5-44e5-999e-109e72323308 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:08.675093 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-5dae3641-b0b3-4659-8d19-5f69a3e1e05c req-178e11f5-f4d5-44e5-999e-109e72323308 service nova] Creating event network-vif-plugged:6fdf3f9d-d5b4-4906-8160-05e737485cfe for instance ce6b1d1f-abeb-4ab7-a402-c003f0171210 on hv-cinder-81306 Oct 12 04:18:08.682244 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-5dae3641-b0b3-4659-8d19-5f69a3e1e05c req-178e11f5-f4d5-44e5-999e-109e72323308 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033859 Oct 12 04:18:08.683082 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 115/219] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:18:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:18:08.706761 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-987aad5f-092f-466b-8df8-94e86c7333ca tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:08.707898 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-987aad5f-092f-466b-8df8-94e86c7333ca tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: ce6b1d1f-abeb-4ab7-a402-c003f0171210] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:08.717185 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-987aad5f-092f-466b-8df8-94e86c7333ca tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:08.717868 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-987aad5f-092f-466b-8df8-94e86c7333ca tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:08.718901 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-987aad5f-092f-466b-8df8-94e86c7333ca tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:08.719486 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-987aad5f-092f-466b-8df8-94e86c7333ca tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:08.746582 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-734300a2-f16f-4731-9a88-02a8f2ce9896 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:08.747395 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-734300a2-f16f-4731-9a88-02a8f2ce9896 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: 1486eeab-56a9-4167-a787-47d83d4aef54] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:08.764381 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-734300a2-f16f-4731-9a88-02a8f2ce9896 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:08.765453 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-734300a2-f16f-4731-9a88-02a8f2ce9896 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:08.766501 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-734300a2-f16f-4731-9a88-02a8f2ce9896 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:08.767309 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-734300a2-f16f-4731-9a88-02a8f2ce9896 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:09.038592 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-987aad5f-092f-466b-8df8-94e86c7333ca tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:09.043289 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-734300a2-f16f-4731-9a88-02a8f2ce9896 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:09.050089 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-987aad5f-092f-466b-8df8-94e86c7333ca tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210" status: 200 len: 1318 microversion: 2.1 time: 0.347915 Oct 12 04:18:09.050467 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-734300a2-f16f-4731-9a88-02a8f2ce9896 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54" status: 200 len: 1314 microversion: 2.1 time: 0.308897 Oct 12 04:18:09.051052 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 116/220] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:08 2021] GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:09.055076 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 105/221] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:08 2021] GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210 => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:09.056018 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-501e06d5-adf7-4457-9b96-a0133475651a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:09.056631 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-501e06d5-adf7-4457-9b96-a0133475651a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:09.062456 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-501e06d5-adf7-4457-9b96-a0133475651a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:09.062941 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-501e06d5-adf7-4457-9b96-a0133475651a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:09.063706 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-501e06d5-adf7-4457-9b96-a0133475651a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:09.064189 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-501e06d5-adf7-4457-9b96-a0133475651a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:09.097086 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-4aadd1b1-acf4-43e9-9645-299b6a8ef7c0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:09.098024 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-4aadd1b1-acf4-43e9-9645-299b6a8ef7c0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:09.104901 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4aadd1b1-acf4-43e9-9645-299b6a8ef7c0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:09.107285 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4aadd1b1-acf4-43e9-9645-299b6a8ef7c0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:09.107285 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4aadd1b1-acf4-43e9-9645-299b6a8ef7c0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:09.107285 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4aadd1b1-acf4-43e9-9645-299b6a8ef7c0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:09.206810 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-501e06d5-adf7-4457-9b96-a0133475651a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:09.214334 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-501e06d5-adf7-4457-9b96-a0133475651a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.162329 Oct 12 04:18:09.215145 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 117/222] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:09 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:09.219786 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ed346394-42a3-4f10-a954-604d69ab2c75 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:09.221239 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ed346394-42a3-4f10-a954-604d69ab2c75 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:09.227008 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ed346394-42a3-4f10-a954-604d69ab2c75 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:09.234038 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ed346394-42a3-4f10-a954-604d69ab2c75 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:09.234038 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ed346394-42a3-4f10-a954-604d69ab2c75 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:09.234038 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ed346394-42a3-4f10-a954-604d69ab2c75 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:09.536431 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-4aadd1b1-acf4-43e9-9645-299b6a8ef7c0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 27734 microversion: 2.1 time: 0.443376 Oct 12 04:18:09.540465 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 106/223] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:09 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 27734 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 04:18:09.553727 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ed346394-42a3-4f10-a954-604d69ab2c75 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 27639 microversion: 2.20 time: 0.337065 Oct 12 04:18:09.557684 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 118/224] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:09 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 27639 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:18:10.067400 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-12a41f8f-3d89-467c-a54e-d5b25f6e136f tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:10.068095 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-12a41f8f-3d89-467c-a54e-d5b25f6e136f tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: 1486eeab-56a9-4167-a787-47d83d4aef54] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:10.074447 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-830f180a-6c3a-4687-8d11-71407b334c05 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:10.075186 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-12a41f8f-3d89-467c-a54e-d5b25f6e136f tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:10.075300 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-830f180a-6c3a-4687-8d11-71407b334c05 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: ce6b1d1f-abeb-4ab7-a402-c003f0171210] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:10.075905 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-12a41f8f-3d89-467c-a54e-d5b25f6e136f tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:10.076805 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-12a41f8f-3d89-467c-a54e-d5b25f6e136f tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:10.077473 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-12a41f8f-3d89-467c-a54e-d5b25f6e136f tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:10.082507 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-830f180a-6c3a-4687-8d11-71407b334c05 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:10.082507 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-830f180a-6c3a-4687-8d11-71407b334c05 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:10.083103 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-830f180a-6c3a-4687-8d11-71407b334c05 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:10.083530 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-830f180a-6c3a-4687-8d11-71407b334c05 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:10.266091 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-12a41f8f-3d89-467c-a54e-d5b25f6e136f tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:10.267893 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-830f180a-6c3a-4687-8d11-71407b334c05 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:10.275320 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-12a41f8f-3d89-467c-a54e-d5b25f6e136f tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54" status: 200 len: 1314 microversion: 2.1 time: 0.212495 Oct 12 04:18:10.275599 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-830f180a-6c3a-4687-8d11-71407b334c05 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210" status: 200 len: 1318 microversion: 2.1 time: 0.208135 Oct 12 04:18:10.276177 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 119/225] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:10 2021] GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:10.280430 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-21bdf947-cf52-4d69-9c77-4cc0ec61bef9 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:10.281202 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-21bdf947-cf52-4d69-9c77-4cc0ec61bef9 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:10.286310 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 107/226] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:10 2021] GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:10.288113 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-21bdf947-cf52-4d69-9c77-4cc0ec61bef9 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:10.288834 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-21bdf947-cf52-4d69-9c77-4cc0ec61bef9 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:10.289959 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-21bdf947-cf52-4d69-9c77-4cc0ec61bef9 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:10.290330 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-21bdf947-cf52-4d69-9c77-4cc0ec61bef9 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:10.418428 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-21bdf947-cf52-4d69-9c77-4cc0ec61bef9 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:10.427099 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-21bdf947-cf52-4d69-9c77-4cc0ec61bef9 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.149934 Oct 12 04:18:10.427650 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 120/227] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:10 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:10.548048 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-dd3bebc1-3dd0-4ac1-b3c6-2f3865e6117a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:10.549216 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-dd3bebc1-3dd0-4ac1-b3c6-2f3865e6117a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:10.554898 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-dd3bebc1-3dd0-4ac1-b3c6-2f3865e6117a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:10.555342 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-dd3bebc1-3dd0-4ac1-b3c6-2f3865e6117a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:10.556102 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-dd3bebc1-3dd0-4ac1-b3c6-2f3865e6117a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:10.556531 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-dd3bebc1-3dd0-4ac1-b3c6-2f3865e6117a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:10.565648 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-00af408c-b617-4d63-854b-6c5668bc13d0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:10.566830 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-00af408c-b617-4d63-854b-6c5668bc13d0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:10.573307 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-00af408c-b617-4d63-854b-6c5668bc13d0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:10.574856 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-00af408c-b617-4d63-854b-6c5668bc13d0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:10.574856 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-00af408c-b617-4d63-854b-6c5668bc13d0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:10.575058 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-00af408c-b617-4d63-854b-6c5668bc13d0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:10.713415 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-dd3bebc1-3dd0-4ac1-b3c6-2f3865e6117a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 27930 microversion: 2.1 time: 0.168827 Oct 12 04:18:10.714057 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 108/228] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:10 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 27930 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:18:10.734297 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-00af408c-b617-4d63-854b-6c5668bc13d0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 27762 microversion: 2.20 time: 0.172429 Oct 12 04:18:10.735376 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 121/229] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:10 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 27762 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 04:18:11.306050 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-a64b1849-cebd-4bf4-ad98-029bc460a91b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:11.306897 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d8ec4857-5fce-4938-9c44-cfba7b38801b tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:11.307598 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-a64b1849-cebd-4bf4-ad98-029bc460a91b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: ce6b1d1f-abeb-4ab7-a402-c003f0171210] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:11.308097 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-d8ec4857-5fce-4938-9c44-cfba7b38801b tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: 1486eeab-56a9-4167-a787-47d83d4aef54] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:11.315246 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a64b1849-cebd-4bf4-ad98-029bc460a91b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:11.315892 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a64b1849-cebd-4bf4-ad98-029bc460a91b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:11.316835 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a64b1849-cebd-4bf4-ad98-029bc460a91b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:11.317421 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a64b1849-cebd-4bf4-ad98-029bc460a91b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:11.317747 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d8ec4857-5fce-4938-9c44-cfba7b38801b tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:11.318517 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d8ec4857-5fce-4938-9c44-cfba7b38801b tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:11.319637 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d8ec4857-5fce-4938-9c44-cfba7b38801b tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:11.322212 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d8ec4857-5fce-4938-9c44-cfba7b38801b tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:11.531118 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-a64b1849-cebd-4bf4-ad98-029bc460a91b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:11.538526 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-d8ec4857-5fce-4938-9c44-cfba7b38801b tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:11.545528 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-a64b1849-cebd-4bf4-ad98-029bc460a91b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210" status: 200 len: 1507 microversion: 2.1 time: 0.243314 Oct 12 04:18:11.546091 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 122/230] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:11 2021] GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210 => generated 1507 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:11.547116 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-d8ec4857-5fce-4938-9c44-cfba7b38801b tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54" status: 200 len: 1314 microversion: 2.1 time: 0.245389 Oct 12 04:18:11.551409 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-c3b83244-480e-487e-9685-4e5a74471aa4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:11.552018 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-c3b83244-480e-487e-9685-4e5a74471aa4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:11.557335 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 109/231] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:11 2021] GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:11.557790 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c3b83244-480e-487e-9685-4e5a74471aa4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:11.558160 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c3b83244-480e-487e-9685-4e5a74471aa4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:11.558951 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c3b83244-480e-487e-9685-4e5a74471aa4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:11.559543 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c3b83244-480e-487e-9685-4e5a74471aa4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:11.568108 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-cee49e60-3173-42d7-8472-b66c774b4d84 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b56d4036-e6fa-4029-a036-af3509100c27"}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:11.570510 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-cee49e60-3173-42d7-8472-b66c774b4d84 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: ce6b1d1f-abeb-4ab7-a402-c003f0171210] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:11.576337 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-cee49e60-3173-42d7-8472-b66c774b4d84 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:11.576902 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-cee49e60-3173-42d7-8472-b66c774b4d84 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:11.577748 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-cee49e60-3173-42d7-8472-b66c774b4d84 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:11.578246 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-cee49e60-3173-42d7-8472-b66c774b4d84 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:11.665779 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.wsgi [None req-cee49e60-3173-42d7-8472-b66c774b4d84 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] HTTP exception thrown: Invalid volume: volume b56d4036-e6fa-4029-a036-af3509100c27 is already attached to instances: 494a399f-a68d-4e9f-8259-fbe4f5b830fa Oct 12 04:18:11.668159 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-cee49e60-3173-42d7-8472-b66c774b4d84 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Returning 400 to user: Invalid volume: volume b56d4036-e6fa-4029-a036-af3509100c27 is already attached to instances: 494a399f-a68d-4e9f-8259-fbe4f5b830fa {{(pid=108898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:18:11.668159 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-cee49e60-3173-42d7-8472-b66c774b4d84 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "POST /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108331 Oct 12 04:18:11.668159 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 110/232] 10.222.0.21 () {60 vars in 1322 bytes} [Tue Oct 12 04:18:11 2021] POST /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 04:18:11.725050 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-fb517cd7-6721-44bc-b225-1effbe76d520 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:11.726037 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-fb517cd7-6721-44bc-b225-1effbe76d520 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:11.744258 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fb517cd7-6721-44bc-b225-1effbe76d520 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:11.748538 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fb517cd7-6721-44bc-b225-1effbe76d520 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:11.748538 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fb517cd7-6721-44bc-b225-1effbe76d520 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:11.748538 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fb517cd7-6721-44bc-b225-1effbe76d520 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:11.751068 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-c3b83244-480e-487e-9685-4e5a74471aa4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:11.760242 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-c3b83244-480e-487e-9685-4e5a74471aa4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.212894 Oct 12 04:18:11.760997 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 123/233] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:11 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:11.766770 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-b6163663-0e84-4fb9-8900-00f711072fa8 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:11.767536 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-b6163663-0e84-4fb9-8900-00f711072fa8 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:11.778003 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b6163663-0e84-4fb9-8900-00f711072fa8 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:11.778003 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b6163663-0e84-4fb9-8900-00f711072fa8 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:11.778003 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b6163663-0e84-4fb9-8900-00f711072fa8 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:11.778003 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b6163663-0e84-4fb9-8900-00f711072fa8 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:11.857361 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-fb517cd7-6721-44bc-b225-1effbe76d520 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 28167 microversion: 2.1 time: 0.136619 Oct 12 04:18:11.860400 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 111/234] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:11 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 28167 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 04:18:11.871518 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-9f84c3c8-a284-4e1c-8814-400b8a70ebc2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:11.872410 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-9f84c3c8-a284-4e1c-8814-400b8a70ebc2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:11.879668 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9f84c3c8-a284-4e1c-8814-400b8a70ebc2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:11.880417 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9f84c3c8-a284-4e1c-8814-400b8a70ebc2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:11.881263 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9f84c3c8-a284-4e1c-8814-400b8a70ebc2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:11.881700 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9f84c3c8-a284-4e1c-8814-400b8a70ebc2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:11.906584 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.objects.instance [None req-b6163663-0e84-4fb9-8900-00f711072fa8 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lazy-loading 'services' on Instance uuid 494a399f-a68d-4e9f-8259-fbe4f5b830fa {{(pid=108897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:18:11.983222 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-9f84c3c8-a284-4e1c-8814-400b8a70ebc2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 28140 microversion: 2.20 time: 0.123811 Oct 12 04:18:11.983851 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 112/235] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:11 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 28140 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:18:12.204365 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-b6163663-0e84-4fb9-8900-00f711072fa8 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "DELETE /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa/os-volume_attachments/b56d4036-e6fa-4029-a036-af3509100c27" status: 202 len: 0 microversion: 2.1 time: 0.441392 Oct 12 04:18:12.205550 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 124/236] 10.222.0.21 () {58 vars in 1415 bytes} [Tue Oct 12 04:18:11 2021] DELETE /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa/os-volume_attachments/b56d4036-e6fa-4029-a036-af3509100c27 => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:18:12.214060 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-fbaf91cf-1c7a-434c-a61b-a9965e76c1aa tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:12.215741 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-fbaf91cf-1c7a-434c-a61b-a9965e76c1aa tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:12.222529 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fbaf91cf-1c7a-434c-a61b-a9965e76c1aa tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:12.222998 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fbaf91cf-1c7a-434c-a61b-a9965e76c1aa tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:12.223770 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fbaf91cf-1c7a-434c-a61b-a9965e76c1aa tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:12.224200 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fbaf91cf-1c7a-434c-a61b-a9965e76c1aa tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:12.252620 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-fbaf91cf-1c7a-434c-a61b-a9965e76c1aa tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042591 Oct 12 04:18:12.253250 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 113/237] 10.222.0.21 () {58 vars in 1301 bytes} [Tue Oct 12 04:18:12 2021] GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:18:12.564454 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-0f8f7f06-a2ba-44a1-b0d9-ec5a507fd5bc tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:12.564924 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-0f8f7f06-a2ba-44a1-b0d9-ec5a507fd5bc tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: 1486eeab-56a9-4167-a787-47d83d4aef54] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:12.576714 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0f8f7f06-a2ba-44a1-b0d9-ec5a507fd5bc tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:12.576714 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0f8f7f06-a2ba-44a1-b0d9-ec5a507fd5bc tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:12.576714 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0f8f7f06-a2ba-44a1-b0d9-ec5a507fd5bc tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:12.576714 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0f8f7f06-a2ba-44a1-b0d9-ec5a507fd5bc tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:12.731361 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-0f8f7f06-a2ba-44a1-b0d9-ec5a507fd5bc tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:12.748107 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-0f8f7f06-a2ba-44a1-b0d9-ec5a507fd5bc tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54" status: 200 len: 1314 microversion: 2.1 time: 0.188457 Oct 12 04:18:12.748681 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 125/238] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:12 2021] GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:12.776858 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-618ab816-8945-4dd6-bc38-e50c44936dca tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:12.777466 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-618ab816-8945-4dd6-bc38-e50c44936dca tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:12.783617 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-618ab816-8945-4dd6-bc38-e50c44936dca tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:12.784057 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-618ab816-8945-4dd6-bc38-e50c44936dca tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:12.784799 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-618ab816-8945-4dd6-bc38-e50c44936dca tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:12.785217 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-618ab816-8945-4dd6-bc38-e50c44936dca tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:12.869366 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-3e8b2651-3166-41d0-a036-098b8dd6a2b5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:12.874924 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-3e8b2651-3166-41d0-a036-098b8dd6a2b5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:12.884086 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3e8b2651-3166-41d0-a036-098b8dd6a2b5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:12.895992 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3e8b2651-3166-41d0-a036-098b8dd6a2b5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:12.896913 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3e8b2651-3166-41d0-a036-098b8dd6a2b5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:12.897452 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3e8b2651-3166-41d0-a036-098b8dd6a2b5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:12.935682 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-618ab816-8945-4dd6-bc38-e50c44936dca tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:12.943896 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-618ab816-8945-4dd6-bc38-e50c44936dca tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.170552 Oct 12 04:18:12.944464 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 114/239] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:12 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:12.973545 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-3e8b2651-3166-41d0-a036-098b8dd6a2b5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 28167 microversion: 2.1 time: 0.107708 Oct 12 04:18:12.974191 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 126/240] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:12 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 28167 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:18:12.994846 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-259511d9-7101-4b5c-9b7e-61ae47002f14 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:12.995803 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-259511d9-7101-4b5c-9b7e-61ae47002f14 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:13.002235 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-259511d9-7101-4b5c-9b7e-61ae47002f14 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:13.003484 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-259511d9-7101-4b5c-9b7e-61ae47002f14 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:13.004243 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-259511d9-7101-4b5c-9b7e-61ae47002f14 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:13.004678 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-259511d9-7101-4b5c-9b7e-61ae47002f14 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:13.091020 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-259511d9-7101-4b5c-9b7e-61ae47002f14 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 28184 microversion: 2.20 time: 0.099555 Oct 12 04:18:13.092419 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 115/241] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:12 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 28184 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 04:18:13.265147 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-a836fca1-ae06-44ea-93f4-7c6bf20c2ee9 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:13.266332 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-a836fca1-ae06-44ea-93f4-7c6bf20c2ee9 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:13.273155 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a836fca1-ae06-44ea-93f4-7c6bf20c2ee9 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:13.273616 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a836fca1-ae06-44ea-93f4-7c6bf20c2ee9 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:13.274465 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a836fca1-ae06-44ea-93f4-7c6bf20c2ee9 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:13.274830 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a836fca1-ae06-44ea-93f4-7c6bf20c2ee9 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:13.310863 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-a836fca1-ae06-44ea-93f4-7c6bf20c2ee9 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049510 Oct 12 04:18:13.315814 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 127/242] 10.222.0.21 () {58 vars in 1301 bytes} [Tue Oct 12 04:18:13 2021] GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:18:13.765491 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-a57f80b9-4ae0-414a-bd7c-d6ebd18d6615 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:13.766191 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-a57f80b9-4ae0-414a-bd7c-d6ebd18d6615 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: 1486eeab-56a9-4167-a787-47d83d4aef54] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:13.773029 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a57f80b9-4ae0-414a-bd7c-d6ebd18d6615 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:13.773476 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a57f80b9-4ae0-414a-bd7c-d6ebd18d6615 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:13.774245 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a57f80b9-4ae0-414a-bd7c-d6ebd18d6615 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:13.774699 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a57f80b9-4ae0-414a-bd7c-d6ebd18d6615 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:13.898909 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-a57f80b9-4ae0-414a-bd7c-d6ebd18d6615 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:13.906577 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-a57f80b9-4ae0-414a-bd7c-d6ebd18d6615 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54" status: 200 len: 1314 microversion: 2.1 time: 0.144980 Oct 12 04:18:13.907239 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 116/243] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:13 2021] GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:13.961244 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-595f8b30-3d7e-4599-bc25-8964aaead02f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:13.961857 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-595f8b30-3d7e-4599-bc25-8964aaead02f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:13.967689 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-595f8b30-3d7e-4599-bc25-8964aaead02f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:13.968150 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-595f8b30-3d7e-4599-bc25-8964aaead02f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:13.968922 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-595f8b30-3d7e-4599-bc25-8964aaead02f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:13.969347 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-595f8b30-3d7e-4599-bc25-8964aaead02f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:13.990052 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d098250c-f8e7-425c-a2fa-c3d9da303e86 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:13.990052 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-d098250c-f8e7-425c-a2fa-c3d9da303e86 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:13.995136 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d098250c-f8e7-425c-a2fa-c3d9da303e86 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:13.996318 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d098250c-f8e7-425c-a2fa-c3d9da303e86 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:13.997541 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d098250c-f8e7-425c-a2fa-c3d9da303e86 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:13.998241 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d098250c-f8e7-425c-a2fa-c3d9da303e86 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:14.082972 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-d098250c-f8e7-425c-a2fa-c3d9da303e86 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 28167 microversion: 2.1 time: 0.101681 Oct 12 04:18:14.083735 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 117/244] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:13 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 28167 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:18:14.099645 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-595f8b30-3d7e-4599-bc25-8964aaead02f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:14.104148 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-566c5701-7239-4604-8627-5432350ba583 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:14.105337 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-566c5701-7239-4604-8627-5432350ba583 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:14.107568 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-595f8b30-3d7e-4599-bc25-8964aaead02f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.149900 Oct 12 04:18:14.108147 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 128/245] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:13 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:14.121415 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-566c5701-7239-4604-8627-5432350ba583 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:14.121415 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-566c5701-7239-4604-8627-5432350ba583 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:14.121415 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-566c5701-7239-4604-8627-5432350ba583 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:14.121415 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-566c5701-7239-4604-8627-5432350ba583 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:14.201445 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-566c5701-7239-4604-8627-5432350ba583 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 28184 microversion: 2.20 time: 0.101128 Oct 12 04:18:14.202646 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 118/246] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:14 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 28184 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:18:14.322385 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-b890f36a-d370-4759-b8a6-8047e900c770 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:14.323423 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-b890f36a-d370-4759-b8a6-8047e900c770 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:14.329769 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b890f36a-d370-4759-b8a6-8047e900c770 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:14.330204 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b890f36a-d370-4759-b8a6-8047e900c770 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:14.331031 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b890f36a-d370-4759-b8a6-8047e900c770 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:14.331456 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b890f36a-d370-4759-b8a6-8047e900c770 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:14.363398 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-b890f36a-d370-4759-b8a6-8047e900c770 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044698 Oct 12 04:18:14.368697 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 129/247] 10.222.0.21 () {58 vars in 1301 bytes} [Tue Oct 12 04:18:14 2021] GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 04:18:14.617572 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-b70727b6-4d49-45d0-b4ea-4bc6b16d4ca7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1874548451", "imageRef": "bf8c5573-3890-45dc-aec8-b1ad89136f80", "flavorRef": "452", "networks": [{"uuid": "382ee370-8814-4057-bb86-a80b3c5a69fd"}]}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:14.646515 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-5fa38680-260b-4273-ab8d-ef14660d292a req-e5c27c21-c0f9-444b-94ec-4512c53e33f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1486eeab-56a9-4167-a787-47d83d4aef54", "name": "network-vif-plugged", "status": "completed", "tag": "fc902d68-62aa-4b28-8d19-1157b9714bdd"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:14.649278 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:18:14.649278 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:18:14.657188 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-5fa38680-260b-4273-ab8d-ef14660d292a req-e5c27c21-c0f9-444b-94ec-4512c53e33f2 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:14.658228 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-5fa38680-260b-4273-ab8d-ef14660d292a req-e5c27c21-c0f9-444b-94ec-4512c53e33f2 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:14.669993 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-5fa38680-260b-4273-ab8d-ef14660d292a req-e5c27c21-c0f9-444b-94ec-4512c53e33f2 service nova] Creating event network-vif-plugged:fc902d68-62aa-4b28-8d19-1157b9714bdd for instance 1486eeab-56a9-4167-a787-47d83d4aef54 on hv-cinder-81306 Oct 12 04:18:14.675773 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-5fa38680-260b-4273-ab8d-ef14660d292a req-e5c27c21-c0f9-444b-94ec-4512c53e33f2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033937 Oct 12 04:18:14.677235 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 130/248] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:18:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:18:14.677706 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.network.neutron [None req-b70727b6-4d49-45d0-b4ea-4bc6b16d4ca7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] validate_networks() for [('382ee370-8814-4057-bb86-a80b3c5a69fd', None, None, None, None, None)] {{(pid=108898) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 04:18:14.924185 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-81f183e0-05fa-4ac2-a9b6-15bdaed1dfd8 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:14.924868 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-81f183e0-05fa-4ac2-a9b6-15bdaed1dfd8 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: 1486eeab-56a9-4167-a787-47d83d4aef54] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:14.931146 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-81f183e0-05fa-4ac2-a9b6-15bdaed1dfd8 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:14.931779 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-81f183e0-05fa-4ac2-a9b6-15bdaed1dfd8 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:14.933043 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-81f183e0-05fa-4ac2-a9b6-15bdaed1dfd8 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:14.933632 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-81f183e0-05fa-4ac2-a9b6-15bdaed1dfd8 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:15.146032 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-81f183e0-05fa-4ac2-a9b6-15bdaed1dfd8 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:15.155301 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-81f183e0-05fa-4ac2-a9b6-15bdaed1dfd8 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54" status: 200 len: 1314 microversion: 2.1 time: 0.235583 Oct 12 04:18:15.155882 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 131/249] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:14 2021] GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:15.171101 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-007b69ad-b6bf-49f0-aa5f-83fd5c7f0447 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:15.171997 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-007b69ad-b6bf-49f0-aa5f-83fd5c7f0447 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:15.173330 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-b70727b6-4d49-45d0-b4ea-4bc6b16d4ca7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Flavor limits 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 04:18:15.173775 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-b70727b6-4d49-45d0-b4ea-4bc6b16d4ca7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Image limits 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 04:18:15.175281 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-b70727b6-4d49-45d0-b4ea-4bc6b16d4ca7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Flavor pref 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 04:18:15.176503 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-b70727b6-4d49-45d0-b4ea-4bc6b16d4ca7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Image pref 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 04:18:15.177411 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-b70727b6-4d49-45d0-b4ea-4bc6b16d4ca7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 04:18:15.179559 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-007b69ad-b6bf-49f0-aa5f-83fd5c7f0447 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:15.180056 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-007b69ad-b6bf-49f0-aa5f-83fd5c7f0447 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:15.180821 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-007b69ad-b6bf-49f0-aa5f-83fd5c7f0447 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:15.187916 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-007b69ad-b6bf-49f0-aa5f-83fd5c7f0447 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:15.189192 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b70727b6-4d49-45d0-b4ea-4bc6b16d4ca7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:15.189798 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b70727b6-4d49-45d0-b4ea-4bc6b16d4ca7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:15.190625 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b70727b6-4d49-45d0-b4ea-4bc6b16d4ca7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:15.191079 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b70727b6-4d49-45d0-b4ea-4bc6b16d4ca7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:15.212049 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-b70727b6-4d49-45d0-b4ea-4bc6b16d4ca7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Getting quotas for project 15e19031226d475dbcf3cdfa50550ef4. Resources: {'cores', 'instances', 'ram'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:18:15.216554 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-b70727b6-4d49-45d0-b4ea-4bc6b16d4ca7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Getting quotas for user e56a34c8635a4d3385b0dc3f40f469bd and project 15e19031226d475dbcf3cdfa50550ef4. Resources: {'cores', 'instances', 'ram'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:18:15.229222 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-b70727b6-4d49-45d0-b4ea-4bc6b16d4ca7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Going to run 1 instances... {{(pid=108898) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 04:18:15.231752 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-b70727b6-4d49-45d0-b4ea-4bc6b16d4ca7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf8c5573-3890-45dc-aec8-b1ad89136f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108898) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 04:18:15.345456 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-b70727b6-4d49-45d0-b4ea-4bc6b16d4ca7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.732280 Oct 12 04:18:15.351289 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 119/250] 10.222.0.21 () {60 vars in 1146 bytes} [Tue Oct 12 04:18:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 04:18:15.352977 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-2e79b4cb-83a6-4d89-b503-cdcbf333daf7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:15.353598 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-2e79b4cb-83a6-4d89-b503-cdcbf333daf7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:15.361055 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2e79b4cb-83a6-4d89-b503-cdcbf333daf7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:15.361508 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2e79b4cb-83a6-4d89-b503-cdcbf333daf7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:15.367353 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2e79b4cb-83a6-4d89-b503-cdcbf333daf7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:15.368092 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2e79b4cb-83a6-4d89-b503-cdcbf333daf7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:15.426542 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-007b69ad-b6bf-49f0-aa5f-83fd5c7f0447 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 28458 microversion: 2.1 time: 0.260003 Oct 12 04:18:15.427409 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 132/251] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:15 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 28458 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:18:15.434894 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-d4abfe2b-fe88-4d42-aa40-72f7acd600de tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:15.435887 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-d4abfe2b-fe88-4d42-aa40-72f7acd600de tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:15.443614 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d4abfe2b-fe88-4d42-aa40-72f7acd600de tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:15.444068 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d4abfe2b-fe88-4d42-aa40-72f7acd600de tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:15.445811 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d4abfe2b-fe88-4d42-aa40-72f7acd600de tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:15.446331 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d4abfe2b-fe88-4d42-aa40-72f7acd600de tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:15.526776 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-2e79b4cb-83a6-4d89-b503-cdcbf333daf7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:15.534937 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-2e79b4cb-83a6-4d89-b503-cdcbf333daf7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.186711 Oct 12 04:18:15.536796 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 120/252] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:15 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:15.550983 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-d4abfe2b-fe88-4d42-aa40-72f7acd600de tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 28475 microversion: 2.20 time: 0.115886 Oct 12 04:18:15.550983 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 133/253] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:15 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 28475 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:18:15.551397 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-be1680e5-0e84-487b-9e63-8c39cc689217 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:15.551397 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-be1680e5-0e84-487b-9e63-8c39cc689217 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:15.627816 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-be1680e5-0e84-487b-9e63-8c39cc689217 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:15.627816 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-be1680e5-0e84-487b-9e63-8c39cc689217 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 200 len: 1218 microversion: 2.1 time: 0.080516 Oct 12 04:18:15.627816 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 121/254] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:15 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:16.172978 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-f7d11020-14f0-4e15-9de2-a43fbc694859 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:16.174357 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-f7d11020-14f0-4e15-9de2-a43fbc694859 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: 1486eeab-56a9-4167-a787-47d83d4aef54] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:16.180776 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f7d11020-14f0-4e15-9de2-a43fbc694859 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:16.181221 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f7d11020-14f0-4e15-9de2-a43fbc694859 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:16.181978 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f7d11020-14f0-4e15-9de2-a43fbc694859 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:16.182406 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f7d11020-14f0-4e15-9de2-a43fbc694859 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:16.307067 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-f7d11020-14f0-4e15-9de2-a43fbc694859 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:16.324229 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-f7d11020-14f0-4e15-9de2-a43fbc694859 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54" status: 200 len: 1314 microversion: 2.1 time: 0.145662 Oct 12 04:18:16.324229 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 134/255] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:16 2021] GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:16.438597 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-95145879-9db0-4ea5-b0c8-0e6f97d9572d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:16.439657 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-95145879-9db0-4ea5-b0c8-0e6f97d9572d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:16.446401 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-95145879-9db0-4ea5-b0c8-0e6f97d9572d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:16.446870 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-95145879-9db0-4ea5-b0c8-0e6f97d9572d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:16.447646 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-95145879-9db0-4ea5-b0c8-0e6f97d9572d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:16.448069 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-95145879-9db0-4ea5-b0c8-0e6f97d9572d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:16.552274 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-94e390a1-8ce2-4273-af8d-20d4904f5d46 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:16.553107 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-94e390a1-8ce2-4273-af8d-20d4904f5d46 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:16.559289 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-94e390a1-8ce2-4273-af8d-20d4904f5d46 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:16.559862 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-94e390a1-8ce2-4273-af8d-20d4904f5d46 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:16.560732 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-94e390a1-8ce2-4273-af8d-20d4904f5d46 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:16.561265 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-94e390a1-8ce2-4273-af8d-20d4904f5d46 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:16.567309 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-95145879-9db0-4ea5-b0c8-0e6f97d9572d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 28625 microversion: 2.1 time: 0.132243 Oct 12 04:18:16.568708 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 122/256] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:16 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 28625 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:18:16.574029 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-79cd5345-262b-4f29-936c-48619510faba tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:16.578588 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-79cd5345-262b-4f29-936c-48619510faba tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:16.582801 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-79cd5345-262b-4f29-936c-48619510faba tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:16.583608 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-79cd5345-262b-4f29-936c-48619510faba tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:16.584534 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-79cd5345-262b-4f29-936c-48619510faba tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:16.585700 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-79cd5345-262b-4f29-936c-48619510faba tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:16.668981 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-79cd5345-262b-4f29-936c-48619510faba tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 28475 microversion: 2.20 time: 0.098605 Oct 12 04:18:16.669705 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 123/257] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:16 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 28475 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:18:16.674931 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-831bbf46-6648-42c3-bd26-aecb769f22de tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:16.675620 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-831bbf46-6648-42c3-bd26-aecb769f22de tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:16.683853 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-831bbf46-6648-42c3-bd26-aecb769f22de tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:16.684127 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-831bbf46-6648-42c3-bd26-aecb769f22de tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:16.685126 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-831bbf46-6648-42c3-bd26-aecb769f22de tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:16.686038 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-831bbf46-6648-42c3-bd26-aecb769f22de tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:16.707734 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-94e390a1-8ce2-4273-af8d-20d4904f5d46 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:16.716594 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-94e390a1-8ce2-4273-af8d-20d4904f5d46 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.167890 Oct 12 04:18:16.717730 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 135/258] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:16 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:16.767688 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-831bbf46-6648-42c3-bd26-aecb769f22de tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:16.802473 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-831bbf46-6648-42c3-bd26-aecb769f22de tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 200 len: 1222 microversion: 2.1 time: 0.131367 Oct 12 04:18:16.803312 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 124/259] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:16 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 1222 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:17.338863 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-97c7dab6-25ad-4650-8d8f-46c6e0e2c0b7 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:17.339469 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-97c7dab6-25ad-4650-8d8f-46c6e0e2c0b7 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: 1486eeab-56a9-4167-a787-47d83d4aef54] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:17.345688 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-97c7dab6-25ad-4650-8d8f-46c6e0e2c0b7 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:17.346281 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-97c7dab6-25ad-4650-8d8f-46c6e0e2c0b7 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:17.347154 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-97c7dab6-25ad-4650-8d8f-46c6e0e2c0b7 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:17.347587 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-97c7dab6-25ad-4650-8d8f-46c6e0e2c0b7 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:17.474460 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-97c7dab6-25ad-4650-8d8f-46c6e0e2c0b7 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:17.481760 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-97c7dab6-25ad-4650-8d8f-46c6e0e2c0b7 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54" status: 200 len: 1498 microversion: 2.1 time: 0.146438 Oct 12 04:18:17.482317 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 136/260] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:17 2021] GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54 => generated 1498 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:17.578305 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-9e4eaa1b-3b30-4d2c-bd30-c87d2a05df8b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:17.579243 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-9e4eaa1b-3b30-4d2c-bd30-c87d2a05df8b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:17.585266 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9e4eaa1b-3b30-4d2c-bd30-c87d2a05df8b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:17.585819 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9e4eaa1b-3b30-4d2c-bd30-c87d2a05df8b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:17.593666 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9e4eaa1b-3b30-4d2c-bd30-c87d2a05df8b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:17.593666 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9e4eaa1b-3b30-4d2c-bd30-c87d2a05df8b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:17.657349 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-9e4eaa1b-3b30-4d2c-bd30-c87d2a05df8b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 28625 microversion: 2.1 time: 0.082488 Oct 12 04:18:17.659119 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 125/261] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:17 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 28625 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:18:17.680220 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-460f72a4-c4e5-4a87-acf7-2f3b92265ba2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:17.681679 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-460f72a4-c4e5-4a87-acf7-2f3b92265ba2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:17.687112 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-460f72a4-c4e5-4a87-acf7-2f3b92265ba2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:17.687565 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-460f72a4-c4e5-4a87-acf7-2f3b92265ba2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:17.688329 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-460f72a4-c4e5-4a87-acf7-2f3b92265ba2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:17.688819 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-460f72a4-c4e5-4a87-acf7-2f3b92265ba2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:17.741701 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-931c4e17-0c52-4a20-9f5a-fb0cea1030e3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:17.742493 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-931c4e17-0c52-4a20-9f5a-fb0cea1030e3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:17.749751 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-931c4e17-0c52-4a20-9f5a-fb0cea1030e3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:17.750338 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-931c4e17-0c52-4a20-9f5a-fb0cea1030e3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:17.752090 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-931c4e17-0c52-4a20-9f5a-fb0cea1030e3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:17.752778 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-931c4e17-0c52-4a20-9f5a-fb0cea1030e3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:17.777124 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-460f72a4-c4e5-4a87-acf7-2f3b92265ba2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 28643 microversion: 2.20 time: 0.100265 Oct 12 04:18:17.781841 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 137/262] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:17 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 28643 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 04:18:17.819242 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-830d6b6f-9fd5-4abf-88dd-b3726d1efdce tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:17.820254 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-830d6b6f-9fd5-4abf-88dd-b3726d1efdce tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:17.827871 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-830d6b6f-9fd5-4abf-88dd-b3726d1efdce tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:17.828315 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-830d6b6f-9fd5-4abf-88dd-b3726d1efdce tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:17.829077 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-830d6b6f-9fd5-4abf-88dd-b3726d1efdce tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:17.829532 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-830d6b6f-9fd5-4abf-88dd-b3726d1efdce tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:17.912132 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-830d6b6f-9fd5-4abf-88dd-b3726d1efdce tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:17.915191 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-931c4e17-0c52-4a20-9f5a-fb0cea1030e3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:17.920264 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-830d6b6f-9fd5-4abf-88dd-b3726d1efdce tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 200 len: 1278 microversion: 2.1 time: 0.105216 Oct 12 04:18:17.921196 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 138/263] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:17 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 1278 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:17.922467 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-931c4e17-0c52-4a20-9f5a-fb0cea1030e3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.185677 Oct 12 04:18:17.923105 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 126/264] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:17 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:18.683032 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-1c129e4c-00e8-4ec7-a49d-147417640a66 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:18.683032 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-1c129e4c-00e8-4ec7-a49d-147417640a66 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:18.685533 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1c129e4c-00e8-4ec7-a49d-147417640a66 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:18.686087 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1c129e4c-00e8-4ec7-a49d-147417640a66 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:18.687061 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1c129e4c-00e8-4ec7-a49d-147417640a66 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:18.687593 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1c129e4c-00e8-4ec7-a49d-147417640a66 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:18.772886 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-1c129e4c-00e8-4ec7-a49d-147417640a66 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 28625 microversion: 2.1 time: 0.099139 Oct 12 04:18:18.773535 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 139/265] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:18 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 28625 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:18:18.790118 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-8d24e264-4795-4c1f-84a2-62209f3286a7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:18.791079 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-8d24e264-4795-4c1f-84a2-62209f3286a7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:18.798535 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8d24e264-4795-4c1f-84a2-62209f3286a7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:18.798932 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8d24e264-4795-4c1f-84a2-62209f3286a7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:18.799777 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8d24e264-4795-4c1f-84a2-62209f3286a7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:18.800190 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8d24e264-4795-4c1f-84a2-62209f3286a7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:18.880815 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-6951ac70-16cc-4a75-89c7-cfecd9a7100a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:18.881634 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-6951ac70-16cc-4a75-89c7-cfecd9a7100a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: 1486eeab-56a9-4167-a787-47d83d4aef54] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:18.888009 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-8d24e264-4795-4c1f-84a2-62209f3286a7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 28643 microversion: 2.20 time: 0.101164 Oct 12 04:18:18.888909 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 127/266] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:18 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 28643 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 04:18:18.890082 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6951ac70-16cc-4a75-89c7-cfecd9a7100a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:18.890890 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6951ac70-16cc-4a75-89c7-cfecd9a7100a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:18.892317 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6951ac70-16cc-4a75-89c7-cfecd9a7100a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:18.892775 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6951ac70-16cc-4a75-89c7-cfecd9a7100a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:18.919061 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-6951ac70-16cc-4a75-89c7-cfecd9a7100a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: 1486eeab-56a9-4167-a787-47d83d4aef54] Going to try to terminate instance {{(pid=108897) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 04:18:18.939950 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-a768e615-250f-4d10-95cf-9e18e51dd9ba tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:18.941012 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-a768e615-250f-4d10-95cf-9e18e51dd9ba tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:18.947842 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a768e615-250f-4d10-95cf-9e18e51dd9ba tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:18.948364 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a768e615-250f-4d10-95cf-9e18e51dd9ba tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:18.949217 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a768e615-250f-4d10-95cf-9e18e51dd9ba tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:18.949706 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a768e615-250f-4d10-95cf-9e18e51dd9ba tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:19.093986 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-a768e615-250f-4d10-95cf-9e18e51dd9ba tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:19.104140 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-a768e615-250f-4d10-95cf-9e18e51dd9ba tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 200 len: 1318 microversion: 2.1 time: 0.168379 Oct 12 04:18:19.105056 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 128/267] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:18 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:19.110771 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-61fb7d85-0347-485f-8d25-aeb86cef9c8d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:19.111572 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-61fb7d85-0347-485f-8d25-aeb86cef9c8d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:19.129429 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-61fb7d85-0347-485f-8d25-aeb86cef9c8d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:19.131999 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-61fb7d85-0347-485f-8d25-aeb86cef9c8d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:19.134005 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-61fb7d85-0347-485f-8d25-aeb86cef9c8d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:19.134611 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-61fb7d85-0347-485f-8d25-aeb86cef9c8d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:19.284878 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-6951ac70-16cc-4a75-89c7-cfecd9a7100a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "DELETE /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54" status: 204 len: 0 microversion: 2.1 time: 0.408152 Oct 12 04:18:19.285477 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 140/268] 10.222.0.21 () {58 vars in 1238 bytes} [Tue Oct 12 04:18:18 2021] DELETE /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 04:18:19.293656 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-b0d78139-2a43-4ca1-97e7-b03eec82cd64 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:19.294306 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-b0d78139-2a43-4ca1-97e7-b03eec82cd64 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: 1486eeab-56a9-4167-a787-47d83d4aef54] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:19.300017 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b0d78139-2a43-4ca1-97e7-b03eec82cd64 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:19.300464 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b0d78139-2a43-4ca1-97e7-b03eec82cd64 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:19.301219 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b0d78139-2a43-4ca1-97e7-b03eec82cd64 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:19.301821 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b0d78139-2a43-4ca1-97e7-b03eec82cd64 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:19.308634 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-61fb7d85-0347-485f-8d25-aeb86cef9c8d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:19.323469 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-61fb7d85-0347-485f-8d25-aeb86cef9c8d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.216421 Oct 12 04:18:19.324046 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 129/269] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:19 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:19.377020 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-a6113a7c-acdf-4ea0-af73-a3cb5b2b76b2 req-a14edcff-dc41-4376-a61f-ab56eb918f3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cb93a9d-e260-48a6-a220-3f8b2af0dfaa", "tag": "701f461a-d960-4813-9dcc-a65b3c60f07b"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:19.379154 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:18:19.379154 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:18:19.394602 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-a6113a7c-acdf-4ea0-af73-a3cb5b2b76b2 req-a14edcff-dc41-4376-a61f-ab56eb918f3e service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:19.395141 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-a6113a7c-acdf-4ea0-af73-a3cb5b2b76b2 req-a14edcff-dc41-4376-a61f-ab56eb918f3e service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:19.406269 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-a6113a7c-acdf-4ea0-af73-a3cb5b2b76b2 req-a14edcff-dc41-4376-a61f-ab56eb918f3e service nova] Creating event network-changed:701f461a-d960-4813-9dcc-a65b3c60f07b for instance 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa on hv-cinder-81306 Oct 12 04:18:19.414194 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-a6113a7c-acdf-4ea0-af73-a3cb5b2b76b2 req-a14edcff-dc41-4376-a61f-ab56eb918f3e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040419 Oct 12 04:18:19.414194 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 130/270] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:18:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:18:19.460142 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-b0d78139-2a43-4ca1-97e7-b03eec82cd64 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:19.468483 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-b0d78139-2a43-4ca1-97e7-b03eec82cd64 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54" status: 200 len: 1504 microversion: 2.1 time: 0.178586 Oct 12 04:18:19.469259 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 141/271] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:19 2021] GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54 => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:19.785430 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-ac0a796c-815c-42b6-b7e4-458e3f223c10 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:19.786589 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-ac0a796c-815c-42b6-b7e4-458e3f223c10 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:19.792647 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ac0a796c-815c-42b6-b7e4-458e3f223c10 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:19.793287 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ac0a796c-815c-42b6-b7e4-458e3f223c10 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:19.793997 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ac0a796c-815c-42b6-b7e4-458e3f223c10 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:19.794528 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ac0a796c-815c-42b6-b7e4-458e3f223c10 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:19.872050 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-ac0a796c-815c-42b6-b7e4-458e3f223c10 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 28625 microversion: 2.1 time: 0.090115 Oct 12 04:18:19.873967 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 131/272] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:19 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 28625 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:18:19.911284 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-9011e1a1-a9d8-4a7d-8104-12c84892e3b6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:19.912238 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-9011e1a1-a9d8-4a7d-8104-12c84892e3b6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:19.918383 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9011e1a1-a9d8-4a7d-8104-12c84892e3b6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:19.922533 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9011e1a1-a9d8-4a7d-8104-12c84892e3b6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:19.922533 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9011e1a1-a9d8-4a7d-8104-12c84892e3b6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:19.922533 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9011e1a1-a9d8-4a7d-8104-12c84892e3b6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:20.001732 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-9011e1a1-a9d8-4a7d-8104-12c84892e3b6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 28643 microversion: 2.20 time: 0.094545 Oct 12 04:18:20.002286 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 142/273] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:19 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 28643 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 04:18:20.125704 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-6f6b641d-ed72-4860-a5f9-c70a26ddd1a3 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:20.126771 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-6f6b641d-ed72-4860-a5f9-c70a26ddd1a3 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:20.133028 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6f6b641d-ed72-4860-a5f9-c70a26ddd1a3 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:20.137435 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6f6b641d-ed72-4860-a5f9-c70a26ddd1a3 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:20.138382 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6f6b641d-ed72-4860-a5f9-c70a26ddd1a3 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:20.138985 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6f6b641d-ed72-4860-a5f9-c70a26ddd1a3 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:20.270964 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-6f6b641d-ed72-4860-a5f9-c70a26ddd1a3 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:20.278508 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-6f6b641d-ed72-4860-a5f9-c70a26ddd1a3 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 200 len: 1318 microversion: 2.1 time: 0.156628 Oct 12 04:18:20.288808 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 132/274] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:20 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:20.341472 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-d88d3ae9-c1cb-4a76-85f8-d9a637c6001f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:20.342165 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-d88d3ae9-c1cb-4a76-85f8-d9a637c6001f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:20.349253 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d88d3ae9-c1cb-4a76-85f8-d9a637c6001f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:20.349697 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d88d3ae9-c1cb-4a76-85f8-d9a637c6001f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:20.350450 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d88d3ae9-c1cb-4a76-85f8-d9a637c6001f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:20.351063 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d88d3ae9-c1cb-4a76-85f8-d9a637c6001f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:20.486002 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-b4b31895-efa0-4484-8755-5c0644be2a3e tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:20.487025 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-b4b31895-efa0-4484-8755-5c0644be2a3e tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: 1486eeab-56a9-4167-a787-47d83d4aef54] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:20.493043 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b4b31895-efa0-4484-8755-5c0644be2a3e tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:20.493581 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b4b31895-efa0-4484-8755-5c0644be2a3e tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:20.498047 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b4b31895-efa0-4484-8755-5c0644be2a3e tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:20.498047 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b4b31895-efa0-4484-8755-5c0644be2a3e tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:20.603085 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-d88d3ae9-c1cb-4a76-85f8-d9a637c6001f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:20.610681 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-d88d3ae9-c1cb-4a76-85f8-d9a637c6001f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.273305 Oct 12 04:18:20.611255 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 143/275] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:20 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:20.754517 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-b4b31895-efa0-4484-8755-5c0644be2a3e tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:20.763258 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-b4b31895-efa0-4484-8755-5c0644be2a3e tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54" status: 200 len: 1504 microversion: 2.1 time: 0.281388 Oct 12 04:18:20.764321 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 133/276] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:20 2021] GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54 => generated 1504 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:20.884621 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-1620def5-e5b3-48f8-a75f-7ffc241cb325 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:20.885595 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-1620def5-e5b3-48f8-a75f-7ffc241cb325 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:20.891353 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1620def5-e5b3-48f8-a75f-7ffc241cb325 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:20.892650 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1620def5-e5b3-48f8-a75f-7ffc241cb325 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:20.893429 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1620def5-e5b3-48f8-a75f-7ffc241cb325 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:20.893935 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1620def5-e5b3-48f8-a75f-7ffc241cb325 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:20.977168 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-1620def5-e5b3-48f8-a75f-7ffc241cb325 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 28625 microversion: 2.1 time: 0.096823 Oct 12 04:18:20.979555 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 144/277] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:20 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 28625 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:18:21.013341 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-9d60dbb5-0f6a-4607-8006-338a89cec815 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:21.014302 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-9d60dbb5-0f6a-4607-8006-338a89cec815 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:21.020392 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9d60dbb5-0f6a-4607-8006-338a89cec815 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:21.020832 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9d60dbb5-0f6a-4607-8006-338a89cec815 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:21.021599 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9d60dbb5-0f6a-4607-8006-338a89cec815 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:21.022030 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9d60dbb5-0f6a-4607-8006-338a89cec815 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:21.113816 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-9d60dbb5-0f6a-4607-8006-338a89cec815 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 28643 microversion: 2.20 time: 0.104007 Oct 12 04:18:21.117730 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 134/278] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:21 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 28643 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 04:18:21.298656 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-c93f90f7-45fd-464b-b4f0-1c76c9cc075a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:21.299662 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-c93f90f7-45fd-464b-b4f0-1c76c9cc075a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:21.307136 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c93f90f7-45fd-464b-b4f0-1c76c9cc075a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:21.307691 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c93f90f7-45fd-464b-b4f0-1c76c9cc075a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:21.308778 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c93f90f7-45fd-464b-b4f0-1c76c9cc075a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:21.309540 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c93f90f7-45fd-464b-b4f0-1c76c9cc075a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:21.447048 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-c93f90f7-45fd-464b-b4f0-1c76c9cc075a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:21.458047 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-c93f90f7-45fd-464b-b4f0-1c76c9cc075a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 200 len: 1318 microversion: 2.1 time: 0.165733 Oct 12 04:18:21.460628 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 145/279] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:21 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:21.628045 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-41e4f5f3-348d-45a5-a392-0a0491dd1d2d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:21.629069 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-41e4f5f3-348d-45a5-a392-0a0491dd1d2d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:21.637151 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-41e4f5f3-348d-45a5-a392-0a0491dd1d2d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:21.637827 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-41e4f5f3-348d-45a5-a392-0a0491dd1d2d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:21.638935 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-41e4f5f3-348d-45a5-a392-0a0491dd1d2d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:21.639559 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-41e4f5f3-348d-45a5-a392-0a0491dd1d2d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:21.781095 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-60ade65c-0361-477c-8c1f-f5518403e066 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:21.782747 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-60ade65c-0361-477c-8c1f-f5518403e066 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: 1486eeab-56a9-4167-a787-47d83d4aef54] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:21.791611 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-60ade65c-0361-477c-8c1f-f5518403e066 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:21.792498 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-60ade65c-0361-477c-8c1f-f5518403e066 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:21.794503 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-60ade65c-0361-477c-8c1f-f5518403e066 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:21.795148 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-60ade65c-0361-477c-8c1f-f5518403e066 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:21.835416 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-41e4f5f3-348d-45a5-a392-0a0491dd1d2d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:21.845471 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-41e4f5f3-348d-45a5-a392-0a0491dd1d2d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.222143 Oct 12 04:18:21.846026 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 135/280] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:21 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:21.967505 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-60ade65c-0361-477c-8c1f-f5518403e066 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:21.977291 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-60ade65c-0361-477c-8c1f-f5518403e066 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54" status: 200 len: 1504 microversion: 2.1 time: 0.199972 Oct 12 04:18:21.978686 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 146/281] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:21 2021] GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54 => generated 1504 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:21.995031 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-8ce3d74b-7258-4185-a02d-357504f0205d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:21.995940 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-8ce3d74b-7258-4185-a02d-357504f0205d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:22.002270 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8ce3d74b-7258-4185-a02d-357504f0205d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:22.002740 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8ce3d74b-7258-4185-a02d-357504f0205d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:22.003600 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8ce3d74b-7258-4185-a02d-357504f0205d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:22.004249 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8ce3d74b-7258-4185-a02d-357504f0205d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:22.056605 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-67f43268-75ea-4414-8963-d38ef01b26eb req-7931abbd-8745-44e2-8177-ebac63a9d13c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1486eeab-56a9-4167-a787-47d83d4aef54", "name": "network-vif-deleted", "tag": "fc902d68-62aa-4b28-8d19-1157b9714bdd"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:22.058303 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:18:22.058303 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:18:22.072598 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-67f43268-75ea-4414-8963-d38ef01b26eb req-7931abbd-8745-44e2-8177-ebac63a9d13c service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:22.072598 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-67f43268-75ea-4414-8963-d38ef01b26eb req-7931abbd-8745-44e2-8177-ebac63a9d13c service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:22.082083 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-67f43268-75ea-4414-8963-d38ef01b26eb req-7931abbd-8745-44e2-8177-ebac63a9d13c service nova] Creating event network-vif-deleted:fc902d68-62aa-4b28-8d19-1157b9714bdd for instance 1486eeab-56a9-4167-a787-47d83d4aef54 on hv-cinder-81306 Oct 12 04:18:22.088528 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-67f43268-75ea-4414-8963-d38ef01b26eb req-7931abbd-8745-44e2-8177-ebac63a9d13c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036715 Oct 12 04:18:22.090132 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 147/282] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:18:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:18:22.111250 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-8ce3d74b-7258-4185-a02d-357504f0205d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 28746 microversion: 2.1 time: 0.119040 Oct 12 04:18:22.111979 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 136/283] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:21 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 28746 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 04:18:22.129442 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-316a8e97-d9b3-4582-9da7-ff8760800b7c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:22.130970 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-316a8e97-d9b3-4582-9da7-ff8760800b7c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:22.139224 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-316a8e97-d9b3-4582-9da7-ff8760800b7c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:22.139705 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-316a8e97-d9b3-4582-9da7-ff8760800b7c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:22.140972 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-316a8e97-d9b3-4582-9da7-ff8760800b7c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:22.141486 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-316a8e97-d9b3-4582-9da7-ff8760800b7c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:22.221093 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-316a8e97-d9b3-4582-9da7-ff8760800b7c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 28643 microversion: 2.20 time: 0.098190 Oct 12 04:18:22.221731 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 148/284] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:22 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 28643 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:18:22.474884 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-f14a1c25-d18f-47da-b38c-9d0fe4d999a6 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:22.475608 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-f14a1c25-d18f-47da-b38c-9d0fe4d999a6 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:22.481988 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f14a1c25-d18f-47da-b38c-9d0fe4d999a6 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:22.482443 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f14a1c25-d18f-47da-b38c-9d0fe4d999a6 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:22.483241 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f14a1c25-d18f-47da-b38c-9d0fe4d999a6 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:22.483671 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f14a1c25-d18f-47da-b38c-9d0fe4d999a6 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:22.626318 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-f14a1c25-d18f-47da-b38c-9d0fe4d999a6 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:22.634435 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-f14a1c25-d18f-47da-b38c-9d0fe4d999a6 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 200 len: 1318 microversion: 2.1 time: 0.163995 Oct 12 04:18:22.635041 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 137/285] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:22 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:22.862646 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-76b32a35-d97c-4903-8741-1b28e277caf3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:22.863372 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-76b32a35-d97c-4903-8741-1b28e277caf3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:22.869694 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-76b32a35-d97c-4903-8741-1b28e277caf3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:22.870136 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-76b32a35-d97c-4903-8741-1b28e277caf3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:22.870932 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-76b32a35-d97c-4903-8741-1b28e277caf3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:22.871371 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-76b32a35-d97c-4903-8741-1b28e277caf3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:22.995686 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-aaf2c22b-f7cb-499b-ac2f-89b7a42f86f2 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:22.996749 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-aaf2c22b-f7cb-499b-ac2f-89b7a42f86f2 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: 1486eeab-56a9-4167-a787-47d83d4aef54] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:23.004131 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-aaf2c22b-f7cb-499b-ac2f-89b7a42f86f2 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:23.004870 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-aaf2c22b-f7cb-499b-ac2f-89b7a42f86f2 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:23.006140 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-aaf2c22b-f7cb-499b-ac2f-89b7a42f86f2 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:23.006515 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-aaf2c22b-f7cb-499b-ac2f-89b7a42f86f2 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:23.025301 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-76b32a35-d97c-4903-8741-1b28e277caf3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:23.035203 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-76b32a35-d97c-4903-8741-1b28e277caf3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.176113 Oct 12 04:18:23.035203 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 149/286] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:22 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:23.124633 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-d7fc637e-2708-4244-ba28-0b49e335d317 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:23.125555 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-d7fc637e-2708-4244-ba28-0b49e335d317 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:23.135866 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d7fc637e-2708-4244-ba28-0b49e335d317 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:23.136382 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d7fc637e-2708-4244-ba28-0b49e335d317 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:23.137543 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d7fc637e-2708-4244-ba28-0b49e335d317 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:23.137913 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d7fc637e-2708-4244-ba28-0b49e335d317 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:23.199346 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-aaf2c22b-f7cb-499b-ac2f-89b7a42f86f2 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:23.199937 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-aaf2c22b-f7cb-499b-ac2f-89b7a42f86f2 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:23.200446 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.objects.instance [None req-aaf2c22b-f7cb-499b-ac2f-89b7a42f86f2 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lazy-loading 'fault' on Instance uuid 1486eeab-56a9-4167-a787-47d83d4aef54 {{(pid=108898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:18:23.250369 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-aaf2c22b-f7cb-499b-ac2f-89b7a42f86f2 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:23.258798 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-aaf2c22b-f7cb-499b-ac2f-89b7a42f86f2 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54" status: 200 len: 1304 microversion: 2.1 time: 0.267132 Oct 12 04:18:23.269735 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 138/287] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:22 2021] GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54 => generated 1304 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:23.269735 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-29863049-1198-424c-aafc-6bf479febde6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:23.269735 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-29863049-1198-424c-aafc-6bf479febde6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:23.273712 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-29863049-1198-424c-aafc-6bf479febde6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:23.276511 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-29863049-1198-424c-aafc-6bf479febde6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:23.276511 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-29863049-1198-424c-aafc-6bf479febde6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:23.276511 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-29863049-1198-424c-aafc-6bf479febde6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:23.284316 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-d7fc637e-2708-4244-ba28-0b49e335d317 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 29885 microversion: 2.1 time: 0.163005 Oct 12 04:18:23.284536 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 150/288] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:23 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 29885 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:18:23.369827 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-29863049-1198-424c-aafc-6bf479febde6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 29130 microversion: 2.20 time: 0.109094 Oct 12 04:18:23.370453 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 139/289] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:23 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 29130 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:18:23.652686 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-0edb01ef-dbf9-40e2-a9fe-3c0c98e7687b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:23.653231 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-0edb01ef-dbf9-40e2-a9fe-3c0c98e7687b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:23.660635 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0edb01ef-dbf9-40e2-a9fe-3c0c98e7687b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:23.661078 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0edb01ef-dbf9-40e2-a9fe-3c0c98e7687b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:23.661848 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0edb01ef-dbf9-40e2-a9fe-3c0c98e7687b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:23.662280 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0edb01ef-dbf9-40e2-a9fe-3c0c98e7687b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:23.789627 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-0edb01ef-dbf9-40e2-a9fe-3c0c98e7687b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:23.799837 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-0edb01ef-dbf9-40e2-a9fe-3c0c98e7687b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 200 len: 1318 microversion: 2.1 time: 0.151235 Oct 12 04:18:23.800569 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 151/290] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:23 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:24.052547 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-2f271598-36bb-4121-9935-fe173eb0e41e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:24.053514 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-2f271598-36bb-4121-9935-fe173eb0e41e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:24.068555 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2f271598-36bb-4121-9935-fe173eb0e41e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:24.069080 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2f271598-36bb-4121-9935-fe173eb0e41e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:24.069860 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2f271598-36bb-4121-9935-fe173eb0e41e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:24.070371 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2f271598-36bb-4121-9935-fe173eb0e41e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:24.197040 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-2f271598-36bb-4121-9935-fe173eb0e41e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:24.201824 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-2f271598-36bb-4121-9935-fe173eb0e41e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1522 microversion: 2.1 time: 0.153788 Oct 12 04:18:24.203099 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 140/291] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:24 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:24.275985 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-97e58fdc-1af4-42b7-803d-adbfc5dac876 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:24.276601 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-97e58fdc-1af4-42b7-803d-adbfc5dac876 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: 1486eeab-56a9-4167-a787-47d83d4aef54] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:24.283054 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-97e58fdc-1af4-42b7-803d-adbfc5dac876 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:24.283513 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-97e58fdc-1af4-42b7-803d-adbfc5dac876 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:24.284280 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-97e58fdc-1af4-42b7-803d-adbfc5dac876 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:24.284711 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-97e58fdc-1af4-42b7-803d-adbfc5dac876 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:24.295193 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-40f23ba5-5291-4852-b6f6-e39f3277f17f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:24.296655 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-40f23ba5-5291-4852-b6f6-e39f3277f17f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:24.298875 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.wsgi [None req-97e58fdc-1af4-42b7-803d-adbfc5dac876 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] HTTP exception thrown: Instance 1486eeab-56a9-4167-a787-47d83d4aef54 could not be found. Oct 12 04:18:24.299481 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-97e58fdc-1af4-42b7-803d-adbfc5dac876 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Returning 404 to user: Instance 1486eeab-56a9-4167-a787-47d83d4aef54 could not be found. {{(pid=108897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:18:24.300306 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-97e58fdc-1af4-42b7-803d-adbfc5dac876 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54" status: 404 len: 111 microversion: 2.1 time: 0.028023 Oct 12 04:18:24.300882 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 152/292] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:24 2021] GET /compute/v2.1/servers/1486eeab-56a9-4167-a787-47d83d4aef54 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:18:24.316389 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-40f23ba5-5291-4852-b6f6-e39f3277f17f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:24.317372 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-40f23ba5-5291-4852-b6f6-e39f3277f17f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:24.319904 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-40f23ba5-5291-4852-b6f6-e39f3277f17f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:24.320346 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-40f23ba5-5291-4852-b6f6-e39f3277f17f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:24.381882 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-69af1741-bed3-4cf8-a05e-4384cd415c2c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:24.387033 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-69af1741-bed3-4cf8-a05e-4384cd415c2c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:24.388800 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-69af1741-bed3-4cf8-a05e-4384cd415c2c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:24.389251 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-69af1741-bed3-4cf8-a05e-4384cd415c2c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:24.390016 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-69af1741-bed3-4cf8-a05e-4384cd415c2c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:24.390455 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-69af1741-bed3-4cf8-a05e-4384cd415c2c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:24.410506 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-40f23ba5-5291-4852-b6f6-e39f3277f17f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 31031 microversion: 2.1 time: 0.117137 Oct 12 04:18:24.410506 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 141/293] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:24 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 31031 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:18:24.415395 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-47f59f96-f8cc-4ad0-807a-6e0c59754562 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-923112563", "imageRef": "bf8c5573-3890-45dc-aec8-b1ad89136f80", "flavorRef": "452", "networks": [{"uuid": "6b995d32-bc3e-445e-a9d2-65b2ff724c69"}]}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:24.468464 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.network.neutron [None req-47f59f96-f8cc-4ad0-807a-6e0c59754562 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] validate_networks() for [('6b995d32-bc3e-445e-a9d2-65b2ff724c69', None, None, None, None, None)] {{(pid=108898) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 04:18:24.497107 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-69af1741-bed3-4cf8-a05e-4384cd415c2c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 30402 microversion: 2.20 time: 0.118617 Oct 12 04:18:24.498059 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 153/294] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:24 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 30402 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 04:18:24.817157 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-94ef4069-8fb6-463d-a175-82d9bdae9e49 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:24.818103 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-94ef4069-8fb6-463d-a175-82d9bdae9e49 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:24.824484 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-94ef4069-8fb6-463d-a175-82d9bdae9e49 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:24.825191 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-94ef4069-8fb6-463d-a175-82d9bdae9e49 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:24.826196 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-94ef4069-8fb6-463d-a175-82d9bdae9e49 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:24.826832 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-94ef4069-8fb6-463d-a175-82d9bdae9e49 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:24.859069 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-47f59f96-f8cc-4ad0-807a-6e0c59754562 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Flavor limits 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 04:18:24.859496 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-47f59f96-f8cc-4ad0-807a-6e0c59754562 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Image limits 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 04:18:24.862085 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-47f59f96-f8cc-4ad0-807a-6e0c59754562 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Flavor pref 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 04:18:24.862085 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-47f59f96-f8cc-4ad0-807a-6e0c59754562 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Image pref 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 04:18:24.862085 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-47f59f96-f8cc-4ad0-807a-6e0c59754562 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 04:18:24.870111 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-47f59f96-f8cc-4ad0-807a-6e0c59754562 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:24.870556 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-47f59f96-f8cc-4ad0-807a-6e0c59754562 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:24.871383 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-47f59f96-f8cc-4ad0-807a-6e0c59754562 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:24.871815 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-47f59f96-f8cc-4ad0-807a-6e0c59754562 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:24.891142 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-47f59f96-f8cc-4ad0-807a-6e0c59754562 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Getting quotas for project 9e7c44417ccc40b9aa1c0a343debf9df. Resources: {'cores', 'instances', 'ram'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:18:24.895822 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-47f59f96-f8cc-4ad0-807a-6e0c59754562 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Getting quotas for user af792a61698f4b0180f7596f9497d5ca and project 9e7c44417ccc40b9aa1c0a343debf9df. Resources: {'cores', 'instances', 'ram'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:18:24.910470 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-47f59f96-f8cc-4ad0-807a-6e0c59754562 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Going to run 1 instances... {{(pid=108898) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 04:18:24.916286 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-47f59f96-f8cc-4ad0-807a-6e0c59754562 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: b15c8087-3918-4533-9b51-fc4ccc0ffb67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf8c5573-3890-45dc-aec8-b1ad89136f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108898) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 04:18:24.954929 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-94ef4069-8fb6-463d-a175-82d9bdae9e49 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:24.963439 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-94ef4069-8fb6-463d-a175-82d9bdae9e49 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 200 len: 1318 microversion: 2.1 time: 0.151310 Oct 12 04:18:24.963980 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 154/295] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:24 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:25.071365 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-47f59f96-f8cc-4ad0-807a-6e0c59754562 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660904 Oct 12 04:18:25.072008 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 142/296] 10.222.0.21 () {60 vars in 1146 bytes} [Tue Oct 12 04:18:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 04:18:25.082299 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-c6c3b380-5fc9-49ee-afd4-b6aa13d22d77 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:25.083302 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-c6c3b380-5fc9-49ee-afd4-b6aa13d22d77 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: b15c8087-3918-4533-9b51-fc4ccc0ffb67] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:25.138238 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-c6c3b380-5fc9-49ee-afd4-b6aa13d22d77 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:25.144729 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-c6c3b380-5fc9-49ee-afd4-b6aa13d22d77 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67" status: 200 len: 1213 microversion: 2.1 time: 0.066361 Oct 12 04:18:25.145277 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 155/297] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:25 2021] GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67 => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:25.219562 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-04830b4d-5b5f-49d5-9dda-5ff5c0ae2a69 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:25.223018 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-04830b4d-5b5f-49d5-9dda-5ff5c0ae2a69 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:25.227130 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-04830b4d-5b5f-49d5-9dda-5ff5c0ae2a69 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:25.227585 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-04830b4d-5b5f-49d5-9dda-5ff5c0ae2a69 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:25.228355 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-04830b4d-5b5f-49d5-9dda-5ff5c0ae2a69 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:25.228812 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-04830b4d-5b5f-49d5-9dda-5ff5c0ae2a69 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:25.358137 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-04830b4d-5b5f-49d5-9dda-5ff5c0ae2a69 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:25.365853 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-04830b4d-5b5f-49d5-9dda-5ff5c0ae2a69 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1502 microversion: 2.1 time: 0.150083 Oct 12 04:18:25.366413 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 143/298] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:25 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:25.383103 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-8d9fcc81-67d2-4150-94a3-a9349971d4f2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:25.384878 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-8d9fcc81-67d2-4150-94a3-a9349971d4f2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:25.396388 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8d9fcc81-67d2-4150-94a3-a9349971d4f2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:25.397633 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8d9fcc81-67d2-4150-94a3-a9349971d4f2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:25.398619 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8d9fcc81-67d2-4150-94a3-a9349971d4f2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:25.399176 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8d9fcc81-67d2-4150-94a3-a9349971d4f2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:25.421228 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-858cd8ce-f650-4f5e-b449-d9e47a53c0df tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:25.422419 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-858cd8ce-f650-4f5e-b449-d9e47a53c0df tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:25.431104 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-858cd8ce-f650-4f5e-b449-d9e47a53c0df tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:25.432375 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-858cd8ce-f650-4f5e-b449-d9e47a53c0df tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:25.476082 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-858cd8ce-f650-4f5e-b449-d9e47a53c0df tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:25.476082 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-858cd8ce-f650-4f5e-b449-d9e47a53c0df tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:25.536165 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-858cd8ce-f650-4f5e-b449-d9e47a53c0df tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 31778 microversion: 2.1 time: 0.119605 Oct 12 04:18:25.540149 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 144/299] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:25 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 31778 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:18:25.541523 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-8d9fcc81-67d2-4150-94a3-a9349971d4f2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:25.546695 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-6096b3cd-ef15-42a2-a3a5-cb929ac76c95 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:25.547681 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-6096b3cd-ef15-42a2-a3a5-cb929ac76c95 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:25.549151 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-8d9fcc81-67d2-4150-94a3-a9349971d4f2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1515 microversion: 2.1 time: 0.170987 Oct 12 04:18:25.549693 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 156/300] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:25 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:25.559983 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6096b3cd-ef15-42a2-a3a5-cb929ac76c95 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:25.559983 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6096b3cd-ef15-42a2-a3a5-cb929ac76c95 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:25.559983 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6096b3cd-ef15-42a2-a3a5-cb929ac76c95 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:25.559983 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6096b3cd-ef15-42a2-a3a5-cb929ac76c95 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:25.656741 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-6096b3cd-ef15-42a2-a3a5-cb929ac76c95 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 31683 microversion: 2.20 time: 0.118576 Oct 12 04:18:25.658013 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 145/301] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:25 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 31683 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:18:25.979856 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-e12c8514-1b06-43e2-9834-da057aa673e4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:25.980459 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-e12c8514-1b06-43e2-9834-da057aa673e4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:25.987493 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e12c8514-1b06-43e2-9834-da057aa673e4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:25.987883 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e12c8514-1b06-43e2-9834-da057aa673e4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:25.988634 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e12c8514-1b06-43e2-9834-da057aa673e4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:25.989062 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e12c8514-1b06-43e2-9834-da057aa673e4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:26.123848 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-e12c8514-1b06-43e2-9834-da057aa673e4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:26.131188 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-e12c8514-1b06-43e2-9834-da057aa673e4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 200 len: 1318 microversion: 2.1 time: 0.154946 Oct 12 04:18:26.131736 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 157/302] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:25 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:26.162114 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-1b285894-db0e-47c4-93b3-b9ac1dea5967 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:26.163131 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-1b285894-db0e-47c4-93b3-b9ac1dea5967 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: b15c8087-3918-4533-9b51-fc4ccc0ffb67] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:26.170446 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1b285894-db0e-47c4-93b3-b9ac1dea5967 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:26.171024 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1b285894-db0e-47c4-93b3-b9ac1dea5967 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:26.171847 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1b285894-db0e-47c4-93b3-b9ac1dea5967 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:26.172402 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1b285894-db0e-47c4-93b3-b9ac1dea5967 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:26.245154 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-1b285894-db0e-47c4-93b3-b9ac1dea5967 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:26.252554 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-1b285894-db0e-47c4-93b3-b9ac1dea5967 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67" status: 200 len: 1217 microversion: 2.1 time: 0.095044 Oct 12 04:18:26.253111 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 146/303] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:26 2021] GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67 => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:26.549772 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-f3acdf68-c9c0-4221-906b-2b156f8228c5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:26.550780 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-f3acdf68-c9c0-4221-906b-2b156f8228c5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:26.560770 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f3acdf68-c9c0-4221-906b-2b156f8228c5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:26.561435 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f3acdf68-c9c0-4221-906b-2b156f8228c5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:26.562505 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f3acdf68-c9c0-4221-906b-2b156f8228c5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:26.563100 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f3acdf68-c9c0-4221-906b-2b156f8228c5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:26.656131 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-f3acdf68-c9c0-4221-906b-2b156f8228c5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 32381 microversion: 2.1 time: 0.110848 Oct 12 04:18:26.657858 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 158/304] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:26 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 32381 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:18:26.669612 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-e713f699-6e38-490d-8dd0-f27ed4af5410 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:26.672046 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-e713f699-6e38-490d-8dd0-f27ed4af5410 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:26.677020 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e713f699-6e38-490d-8dd0-f27ed4af5410 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:26.677562 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e713f699-6e38-490d-8dd0-f27ed4af5410 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:26.678335 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e713f699-6e38-490d-8dd0-f27ed4af5410 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:26.678829 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e713f699-6e38-490d-8dd0-f27ed4af5410 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:26.724955 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-50390777-c640-4439-8921-30da87b94942 req-dc146e8f-f799-4121-ac7d-4ecd26dffe42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cb93a9d-e260-48a6-a220-3f8b2af0dfaa", "name": "network-vif-plugged", "status": "completed", "tag": "701f461a-d960-4813-9dcc-a65b3c60f07b"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:26.727224 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:18:26.727224 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:18:26.738208 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-50390777-c640-4439-8921-30da87b94942 req-dc146e8f-f799-4121-ac7d-4ecd26dffe42 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:26.738956 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-50390777-c640-4439-8921-30da87b94942 req-dc146e8f-f799-4121-ac7d-4ecd26dffe42 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:26.750272 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-50390777-c640-4439-8921-30da87b94942 req-dc146e8f-f799-4121-ac7d-4ecd26dffe42 service nova] Creating event network-vif-plugged:701f461a-d960-4813-9dcc-a65b3c60f07b for instance 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa on hv-cinder-81306 Oct 12 04:18:26.755537 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-50390777-c640-4439-8921-30da87b94942 req-dc146e8f-f799-4121-ac7d-4ecd26dffe42 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034793 Oct 12 04:18:26.762176 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 159/305] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:18:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:18:26.804937 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-e713f699-6e38-490d-8dd0-f27ed4af5410 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 32697 microversion: 2.20 time: 0.139860 Oct 12 04:18:26.805579 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 147/306] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:26 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 32697 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 04:18:27.148359 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-43d7b0cd-fd12-493a-b11d-0854afc5bb1f tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:27.149472 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-43d7b0cd-fd12-493a-b11d-0854afc5bb1f tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:27.156044 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-43d7b0cd-fd12-493a-b11d-0854afc5bb1f tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:27.156493 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-43d7b0cd-fd12-493a-b11d-0854afc5bb1f tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:27.157255 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-43d7b0cd-fd12-493a-b11d-0854afc5bb1f tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:27.157837 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-43d7b0cd-fd12-493a-b11d-0854afc5bb1f tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:27.269656 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-cea963e4-ea47-4881-a6f0-91b76e140231 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:27.270397 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-cea963e4-ea47-4881-a6f0-91b76e140231 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: b15c8087-3918-4533-9b51-fc4ccc0ffb67] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:27.277464 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-cea963e4-ea47-4881-a6f0-91b76e140231 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:27.277907 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-cea963e4-ea47-4881-a6f0-91b76e140231 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:27.278691 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-cea963e4-ea47-4881-a6f0-91b76e140231 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:27.279118 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-cea963e4-ea47-4881-a6f0-91b76e140231 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:27.362273 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-43d7b0cd-fd12-493a-b11d-0854afc5bb1f tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:27.364310 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-cea963e4-ea47-4881-a6f0-91b76e140231 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:27.369580 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-43d7b0cd-fd12-493a-b11d-0854afc5bb1f tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 200 len: 1318 microversion: 2.1 time: 0.225242 Oct 12 04:18:27.370129 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 160/307] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:27 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:27.371708 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-cea963e4-ea47-4881-a6f0-91b76e140231 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67" status: 200 len: 1265 microversion: 2.1 time: 0.106060 Oct 12 04:18:27.372258 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 148/308] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:27 2021] GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67 => generated 1265 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:27.434472 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-9acdd22e-7956-485c-8273-7f483f1a3f10 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:27.435601 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-9acdd22e-7956-485c-8273-7f483f1a3f10 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:27.449484 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9acdd22e-7956-485c-8273-7f483f1a3f10 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:27.449484 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9acdd22e-7956-485c-8273-7f483f1a3f10 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:27.449484 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9acdd22e-7956-485c-8273-7f483f1a3f10 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:27.449484 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9acdd22e-7956-485c-8273-7f483f1a3f10 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:27.472338 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.objects.instance [None req-9acdd22e-7956-485c-8273-7f483f1a3f10 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lazy-loading 'flavor' on Instance uuid d927fdb5-40b1-4279-9f0c-7006831e05d2 {{(pid=108897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:18:27.669555 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-19426f66-0d1b-4a6f-9432-a8623030dd50 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:27.670590 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-19426f66-0d1b-4a6f-9432-a8623030dd50 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:27.677488 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-19426f66-0d1b-4a6f-9432-a8623030dd50 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:27.677929 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-19426f66-0d1b-4a6f-9432-a8623030dd50 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:27.678725 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-19426f66-0d1b-4a6f-9432-a8623030dd50 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:27.679160 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-19426f66-0d1b-4a6f-9432-a8623030dd50 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:27.713138 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-9acdd22e-7956-485c-8273-7f483f1a3f10 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "POST /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2/action" status: 200 len: 32 microversion: 2.1 time: 0.283307 Oct 12 04:18:27.713744 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 161/309] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:27 2021] POST /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2/action => generated 32 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 04:18:27.723595 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-946ed710-0b96-4fcc-a5e7-9323946118b1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:27.724289 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-946ed710-0b96-4fcc-a5e7-9323946118b1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:27.730171 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-946ed710-0b96-4fcc-a5e7-9323946118b1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:27.730841 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-946ed710-0b96-4fcc-a5e7-9323946118b1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:27.731772 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-946ed710-0b96-4fcc-a5e7-9323946118b1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:27.732436 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-946ed710-0b96-4fcc-a5e7-9323946118b1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:27.793858 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-19426f66-0d1b-4a6f-9432-a8623030dd50 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 32969 microversion: 2.1 time: 0.129300 Oct 12 04:18:27.794488 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 149/310] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:27 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 32969 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:18:27.817510 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-10ab05e6-be82-4a05-935f-6badfa1b93a6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:27.819140 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-10ab05e6-be82-4a05-935f-6badfa1b93a6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:27.826376 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-10ab05e6-be82-4a05-935f-6badfa1b93a6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:27.826883 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-10ab05e6-be82-4a05-935f-6badfa1b93a6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:27.827681 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-10ab05e6-be82-4a05-935f-6badfa1b93a6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:27.828140 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-10ab05e6-be82-4a05-935f-6badfa1b93a6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:27.874680 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-946ed710-0b96-4fcc-a5e7-9323946118b1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:27.883572 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-946ed710-0b96-4fcc-a5e7-9323946118b1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1521 microversion: 2.1 time: 0.164363 Oct 12 04:18:27.884281 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 162/311] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:27 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:27.971119 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-10ab05e6-be82-4a05-935f-6badfa1b93a6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 33343 microversion: 2.20 time: 0.157917 Oct 12 04:18:27.972595 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 150/312] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:27 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 33343 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 04:18:28.385495 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-d702738d-de39-46c8-907a-6a69f47dcf2b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:28.386095 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-d702738d-de39-46c8-907a-6a69f47dcf2b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:28.393232 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d702738d-de39-46c8-907a-6a69f47dcf2b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:28.396970 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d702738d-de39-46c8-907a-6a69f47dcf2b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:28.396970 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d702738d-de39-46c8-907a-6a69f47dcf2b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:28.396970 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d702738d-de39-46c8-907a-6a69f47dcf2b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:28.397806 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-2ce1eaa6-0f37-409c-815a-1542e91d8b7b tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:28.398792 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-2ce1eaa6-0f37-409c-815a-1542e91d8b7b tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: b15c8087-3918-4533-9b51-fc4ccc0ffb67] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:28.407051 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2ce1eaa6-0f37-409c-815a-1542e91d8b7b tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:28.407691 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2ce1eaa6-0f37-409c-815a-1542e91d8b7b tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:28.408572 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2ce1eaa6-0f37-409c-815a-1542e91d8b7b tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:28.409114 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2ce1eaa6-0f37-409c-815a-1542e91d8b7b tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:28.506742 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-2ce1eaa6-0f37-409c-815a-1542e91d8b7b tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:28.514747 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-2ce1eaa6-0f37-409c-815a-1542e91d8b7b tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67" status: 200 len: 1271 microversion: 2.1 time: 0.121919 Oct 12 04:18:28.515542 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 151/313] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:28 2021] GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67 => generated 1271 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:28.644036 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-d702738d-de39-46c8-907a-6a69f47dcf2b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:28.651358 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-d702738d-de39-46c8-907a-6a69f47dcf2b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 200 len: 1318 microversion: 2.1 time: 0.269579 Oct 12 04:18:28.651918 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 163/314] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:28 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:28.806753 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-657ed540-12ed-42cc-a582-09a74b304282 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:28.807829 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-657ed540-12ed-42cc-a582-09a74b304282 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:28.814188 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-657ed540-12ed-42cc-a582-09a74b304282 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:28.815070 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-657ed540-12ed-42cc-a582-09a74b304282 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:28.816047 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-657ed540-12ed-42cc-a582-09a74b304282 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:28.816699 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-657ed540-12ed-42cc-a582-09a74b304282 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:28.900700 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-5a292b10-55ab-48ca-b234-92bc1b0cbd2b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:28.901765 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-5a292b10-55ab-48ca-b234-92bc1b0cbd2b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:28.910021 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5a292b10-55ab-48ca-b234-92bc1b0cbd2b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:28.910021 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5a292b10-55ab-48ca-b234-92bc1b0cbd2b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:28.910021 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5a292b10-55ab-48ca-b234-92bc1b0cbd2b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:28.910341 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5a292b10-55ab-48ca-b234-92bc1b0cbd2b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:28.925182 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-657ed540-12ed-42cc-a582-09a74b304282 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 33411 microversion: 2.1 time: 0.123040 Oct 12 04:18:28.929905 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 152/315] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:28 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 33411 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:18:28.984011 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-a693e827-0d6b-4011-8122-5bdf35366235 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:28.986610 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-a693e827-0d6b-4011-8122-5bdf35366235 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:28.996888 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a693e827-0d6b-4011-8122-5bdf35366235 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:28.996888 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a693e827-0d6b-4011-8122-5bdf35366235 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:28.996888 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a693e827-0d6b-4011-8122-5bdf35366235 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:29.000486 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a693e827-0d6b-4011-8122-5bdf35366235 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:29.115591 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-a693e827-0d6b-4011-8122-5bdf35366235 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 33700 microversion: 2.20 time: 0.135760 Oct 12 04:18:29.116274 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 153/316] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:28 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 33700 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:18:29.141743 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-5a292b10-55ab-48ca-b234-92bc1b0cbd2b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:29.149700 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-5a292b10-55ab-48ca-b234-92bc1b0cbd2b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1521 microversion: 2.1 time: 0.252755 Oct 12 04:18:29.150265 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 164/317] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:28 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:29.535464 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-7afb9b54-0261-4d10-838f-cbca0edbf6fa tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:29.536264 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-7afb9b54-0261-4d10-838f-cbca0edbf6fa tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: b15c8087-3918-4533-9b51-fc4ccc0ffb67] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:29.543569 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7afb9b54-0261-4d10-838f-cbca0edbf6fa tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:29.544306 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7afb9b54-0261-4d10-838f-cbca0edbf6fa tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:29.545301 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7afb9b54-0261-4d10-838f-cbca0edbf6fa tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:29.546144 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7afb9b54-0261-4d10-838f-cbca0edbf6fa tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:29.667852 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-90ecc2e7-27c3-4e5a-aa27-4106efc84f78 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:29.671859 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-90ecc2e7-27c3-4e5a-aa27-4106efc84f78 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:29.674857 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-90ecc2e7-27c3-4e5a-aa27-4106efc84f78 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:29.675480 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-90ecc2e7-27c3-4e5a-aa27-4106efc84f78 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:29.676116 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-90ecc2e7-27c3-4e5a-aa27-4106efc84f78 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:29.676551 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-90ecc2e7-27c3-4e5a-aa27-4106efc84f78 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:29.800401 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-7afb9b54-0261-4d10-838f-cbca0edbf6fa tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:29.809211 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-7afb9b54-0261-4d10-838f-cbca0edbf6fa tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67" status: 200 len: 1313 microversion: 2.1 time: 0.280624 Oct 12 04:18:29.812637 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 154/318] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:29 2021] GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:29.937780 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-c64fb4ed-43dc-42a4-a670-d55932d59a5a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:29.940203 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-c64fb4ed-43dc-42a4-a670-d55932d59a5a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:29.941213 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-90ecc2e7-27c3-4e5a-aa27-4106efc84f78 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:29.948790 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c64fb4ed-43dc-42a4-a670-d55932d59a5a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:29.949431 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-90ecc2e7-27c3-4e5a-aa27-4106efc84f78 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 200 len: 1508 microversion: 2.1 time: 0.285087 Oct 12 04:18:29.950200 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c64fb4ed-43dc-42a4-a670-d55932d59a5a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:29.951277 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c64fb4ed-43dc-42a4-a670-d55932d59a5a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:29.951950 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c64fb4ed-43dc-42a4-a670-d55932d59a5a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:29.960744 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 165/319] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:29 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 1508 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:30.083770 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-c64fb4ed-43dc-42a4-a670-d55932d59a5a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 34104 microversion: 2.1 time: 0.149900 Oct 12 04:18:30.086288 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 155/320] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:29 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 34104 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 04:18:30.128864 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-b9b0cc07-0b16-4437-9904-6141e1a72214 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:30.129765 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-b9b0cc07-0b16-4437-9904-6141e1a72214 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:30.135707 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b9b0cc07-0b16-4437-9904-6141e1a72214 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:30.140884 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b9b0cc07-0b16-4437-9904-6141e1a72214 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:30.140884 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b9b0cc07-0b16-4437-9904-6141e1a72214 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:30.140884 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b9b0cc07-0b16-4437-9904-6141e1a72214 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:30.167905 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-818fa366-7571-4ddc-b97f-aec8426ce808 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:30.169782 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-818fa366-7571-4ddc-b97f-aec8426ce808 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:30.177878 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-818fa366-7571-4ddc-b97f-aec8426ce808 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:30.180755 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-818fa366-7571-4ddc-b97f-aec8426ce808 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:30.182497 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-818fa366-7571-4ddc-b97f-aec8426ce808 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:30.183185 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-818fa366-7571-4ddc-b97f-aec8426ce808 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:30.244854 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-b9b0cc07-0b16-4437-9904-6141e1a72214 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 34357 microversion: 2.20 time: 0.119981 Oct 12 04:18:30.247469 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 166/321] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:30 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 34357 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:18:30.437888 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-818fa366-7571-4ddc-b97f-aec8426ce808 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:30.463752 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-818fa366-7571-4ddc-b97f-aec8426ce808 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1521 microversion: 2.1 time: 0.299910 Oct 12 04:18:30.464327 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 156/322] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:30 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:30.697262 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-08b50892-d9ba-4f06-b48a-cbab813c93bf req-6e065339-d253-4fee-a037-bcafa33716d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b15c8087-3918-4533-9b51-fc4ccc0ffb67", "tag": "41cc2906-be10-4a86-ad90-4501c5163de7"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:30.699089 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:18:30.699089 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:18:30.707601 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-08b50892-d9ba-4f06-b48a-cbab813c93bf req-6e065339-d253-4fee-a037-bcafa33716d6 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:30.708033 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-08b50892-d9ba-4f06-b48a-cbab813c93bf req-6e065339-d253-4fee-a037-bcafa33716d6 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:30.718649 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-08b50892-d9ba-4f06-b48a-cbab813c93bf req-6e065339-d253-4fee-a037-bcafa33716d6 service nova] Creating event network-changed:41cc2906-be10-4a86-ad90-4501c5163de7 for instance b15c8087-3918-4533-9b51-fc4ccc0ffb67 on hv-cinder-81306 Oct 12 04:18:30.723243 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-08b50892-d9ba-4f06-b48a-cbab813c93bf req-6e065339-d253-4fee-a037-bcafa33716d6 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029831 Oct 12 04:18:30.723727 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 167/323] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:18:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:18:30.829545 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-c8ee8ae6-9dcb-42ab-990b-3d54c86e2fed tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:30.830818 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-c8ee8ae6-9dcb-42ab-990b-3d54c86e2fed tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: b15c8087-3918-4533-9b51-fc4ccc0ffb67] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:30.841564 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c8ee8ae6-9dcb-42ab-990b-3d54c86e2fed tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:30.842013 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c8ee8ae6-9dcb-42ab-990b-3d54c86e2fed tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:30.842828 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c8ee8ae6-9dcb-42ab-990b-3d54c86e2fed tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:30.843281 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c8ee8ae6-9dcb-42ab-990b-3d54c86e2fed tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:31.059342 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c8ee8ae6-9dcb-42ab-990b-3d54c86e2fed tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:31.064695 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-c8ee8ae6-9dcb-42ab-990b-3d54c86e2fed tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67" status: 200 len: 1313 microversion: 2.1 time: 0.238647 Oct 12 04:18:31.065592 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 157/324] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:30 2021] GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:31.096841 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-0af094a1-d9e9-4e2d-bb1e-7bbf56f7b0bf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:31.097930 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-0af094a1-d9e9-4e2d-bb1e-7bbf56f7b0bf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:31.105588 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0af094a1-d9e9-4e2d-bb1e-7bbf56f7b0bf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:31.109943 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0af094a1-d9e9-4e2d-bb1e-7bbf56f7b0bf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:31.109943 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0af094a1-d9e9-4e2d-bb1e-7bbf56f7b0bf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:31.109943 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0af094a1-d9e9-4e2d-bb1e-7bbf56f7b0bf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:31.205206 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-0af094a1-d9e9-4e2d-bb1e-7bbf56f7b0bf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 35562 microversion: 2.1 time: 0.112753 Oct 12 04:18:31.206244 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 168/325] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:31 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 35562 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:18:31.257519 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-8416cf87-5e66-4c2c-90b5-c1cf633a60a2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:31.258444 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-8416cf87-5e66-4c2c-90b5-c1cf633a60a2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:31.266146 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8416cf87-5e66-4c2c-90b5-c1cf633a60a2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:31.267138 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8416cf87-5e66-4c2c-90b5-c1cf633a60a2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:31.268494 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8416cf87-5e66-4c2c-90b5-c1cf633a60a2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:31.269033 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8416cf87-5e66-4c2c-90b5-c1cf633a60a2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:31.443756 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-8416cf87-5e66-4c2c-90b5-c1cf633a60a2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 35087 microversion: 2.20 time: 0.189563 Oct 12 04:18:31.444588 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 158/326] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:31 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 35087 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:18:31.481638 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-f44a1f87-b183-4d17-accb-21e7c7849add tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:31.482318 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-f44a1f87-b183-4d17-accb-21e7c7849add tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:31.489272 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f44a1f87-b183-4d17-accb-21e7c7849add tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:31.489717 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f44a1f87-b183-4d17-accb-21e7c7849add tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:31.490467 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f44a1f87-b183-4d17-accb-21e7c7849add tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:31.490928 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f44a1f87-b183-4d17-accb-21e7c7849add tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:31.659690 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-f44a1f87-b183-4d17-accb-21e7c7849add tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:31.668289 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-f44a1f87-b183-4d17-accb-21e7c7849add tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1521 microversion: 2.1 time: 0.190501 Oct 12 04:18:31.669601 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 169/327] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:31 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:31.905484 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-bdef1ef9-7b8f-4c24-85e2-827716edce30 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5933296e-195d-4a8e-a063-75631d7cf593"}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:31.907151 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-bdef1ef9-7b8f-4c24-85e2-827716edce30 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:31.913577 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-bdef1ef9-7b8f-4c24-85e2-827716edce30 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:31.914024 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-bdef1ef9-7b8f-4c24-85e2-827716edce30 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:31.914829 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-bdef1ef9-7b8f-4c24-85e2-827716edce30 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:31.915424 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-bdef1ef9-7b8f-4c24-85e2-827716edce30 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:32.081665 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-db4a8cb7-7387-4488-83b3-ff9d8d1d773a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:32.082432 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-db4a8cb7-7387-4488-83b3-ff9d8d1d773a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: b15c8087-3918-4533-9b51-fc4ccc0ffb67] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:32.088593 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-db4a8cb7-7387-4488-83b3-ff9d8d1d773a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:32.089111 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-db4a8cb7-7387-4488-83b3-ff9d8d1d773a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:32.089950 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-db4a8cb7-7387-4488-83b3-ff9d8d1d773a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:32.090457 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-db4a8cb7-7387-4488-83b3-ff9d8d1d773a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:32.243788 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-db4a8cb7-7387-4488-83b3-ff9d8d1d773a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:32.251696 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-db4a8cb7-7387-4488-83b3-ff9d8d1d773a tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67" status: 200 len: 1313 microversion: 2.1 time: 0.173491 Oct 12 04:18:32.252321 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 170/328] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:32 2021] GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:32.256711 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-d291cd33-3603-4ae4-b701-05f0a6d27aa5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:32.257739 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-d291cd33-3603-4ae4-b701-05f0a6d27aa5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:32.263761 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d291cd33-3603-4ae4-b701-05f0a6d27aa5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:32.264275 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d291cd33-3603-4ae4-b701-05f0a6d27aa5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:32.265439 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d291cd33-3603-4ae4-b701-05f0a6d27aa5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:32.265548 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d291cd33-3603-4ae4-b701-05f0a6d27aa5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:32.368751 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-d291cd33-3603-4ae4-b701-05f0a6d27aa5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 36431 microversion: 2.1 time: 0.115176 Oct 12 04:18:32.369360 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 171/329] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:32 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 36431 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:18:32.457441 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-a53efb24-f44e-49e4-85d7-b96a572bd3ef tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:32.458511 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-a53efb24-f44e-49e4-85d7-b96a572bd3ef tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:32.465761 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a53efb24-f44e-49e4-85d7-b96a572bd3ef tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:32.466211 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a53efb24-f44e-49e4-85d7-b96a572bd3ef tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:32.467027 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a53efb24-f44e-49e4-85d7-b96a572bd3ef tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:32.467460 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a53efb24-f44e-49e4-85d7-b96a572bd3ef tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:32.564258 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-a53efb24-f44e-49e4-85d7-b96a572bd3ef tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 35801 microversion: 2.20 time: 0.111374 Oct 12 04:18:32.564898 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 172/330] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:32 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 35801 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 04:18:32.686190 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-39a8d10a-a589-4fdb-a909-246505a9a28a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:32.686896 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-39a8d10a-a589-4fdb-a909-246505a9a28a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:32.693245 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-39a8d10a-a589-4fdb-a909-246505a9a28a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:32.693686 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-39a8d10a-a589-4fdb-a909-246505a9a28a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:32.694429 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-39a8d10a-a589-4fdb-a909-246505a9a28a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:32.694880 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-39a8d10a-a589-4fdb-a909-246505a9a28a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:32.819313 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-39a8d10a-a589-4fdb-a909-246505a9a28a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:32.832499 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-39a8d10a-a589-4fdb-a909-246505a9a28a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1521 microversion: 2.1 time: 0.144596 Oct 12 04:18:32.832499 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 173/331] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:32 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:32.867278 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-bdef1ef9-7b8f-4c24-85e2-827716edce30 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "POST /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.966014 Oct 12 04:18:32.871287 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 159/332] 10.222.0.21 () {60 vars in 1322 bytes} [Tue Oct 12 04:18:31 2021] POST /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa/os-volume_attachments => generated 194 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:18:33.269023 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-e456a831-705b-48e2-83ef-a69febc66178 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:33.269620 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-e456a831-705b-48e2-83ef-a69febc66178 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: b15c8087-3918-4533-9b51-fc4ccc0ffb67] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:33.275439 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e456a831-705b-48e2-83ef-a69febc66178 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:33.278491 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e456a831-705b-48e2-83ef-a69febc66178 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:33.278491 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e456a831-705b-48e2-83ef-a69febc66178 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:33.278491 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e456a831-705b-48e2-83ef-a69febc66178 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:33.382202 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-942fe0df-11ed-4d1e-9ee5-6c2184f8732c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:33.383295 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-942fe0df-11ed-4d1e-9ee5-6c2184f8732c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:33.390385 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-942fe0df-11ed-4d1e-9ee5-6c2184f8732c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:33.390865 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-942fe0df-11ed-4d1e-9ee5-6c2184f8732c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:33.392255 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-942fe0df-11ed-4d1e-9ee5-6c2184f8732c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:33.392691 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-942fe0df-11ed-4d1e-9ee5-6c2184f8732c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:33.403219 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-e456a831-705b-48e2-83ef-a69febc66178 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:33.410634 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-e456a831-705b-48e2-83ef-a69febc66178 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67" status: 200 len: 1313 microversion: 2.1 time: 0.145826 Oct 12 04:18:33.411220 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 174/333] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:33 2021] GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:33.482987 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-942fe0df-11ed-4d1e-9ee5-6c2184f8732c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 36985 microversion: 2.1 time: 0.105018 Oct 12 04:18:33.487533 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 160/334] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:33 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 36985 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 04:18:33.576433 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-4c945534-bd13-413e-8134-4cf562b13df1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:33.577336 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-4c945534-bd13-413e-8134-4cf562b13df1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:33.584523 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4c945534-bd13-413e-8134-4cf562b13df1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:33.584523 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4c945534-bd13-413e-8134-4cf562b13df1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:33.585098 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4c945534-bd13-413e-8134-4cf562b13df1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:33.585524 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4c945534-bd13-413e-8134-4cf562b13df1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:33.679759 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-4c945534-bd13-413e-8134-4cf562b13df1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 36666 microversion: 2.20 time: 0.106952 Oct 12 04:18:33.680383 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 175/335] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:33 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 36666 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:18:33.844077 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-372428de-06d3-4fce-b8f9-c633298466a7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:33.844771 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-372428de-06d3-4fce-b8f9-c633298466a7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:33.851380 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-372428de-06d3-4fce-b8f9-c633298466a7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:33.851819 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-372428de-06d3-4fce-b8f9-c633298466a7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:33.852575 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-372428de-06d3-4fce-b8f9-c633298466a7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:33.853001 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-372428de-06d3-4fce-b8f9-c633298466a7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:33.978067 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-372428de-06d3-4fce-b8f9-c633298466a7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:33.995720 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-372428de-06d3-4fce-b8f9-c633298466a7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1521 microversion: 2.1 time: 0.155815 Oct 12 04:18:33.996280 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 161/336] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:33 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:34.429853 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-231f1c4c-1853-42dd-a3a9-4fd7a5a32794 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:34.430534 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-231f1c4c-1853-42dd-a3a9-4fd7a5a32794 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: b15c8087-3918-4533-9b51-fc4ccc0ffb67] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:34.437139 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-231f1c4c-1853-42dd-a3a9-4fd7a5a32794 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:34.437486 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-231f1c4c-1853-42dd-a3a9-4fd7a5a32794 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:34.438236 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-231f1c4c-1853-42dd-a3a9-4fd7a5a32794 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:34.438787 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-231f1c4c-1853-42dd-a3a9-4fd7a5a32794 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:34.494058 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-61477b5f-6cf9-4670-b754-e33ea3a2f978 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:34.495186 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-61477b5f-6cf9-4670-b754-e33ea3a2f978 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:34.501191 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-61477b5f-6cf9-4670-b754-e33ea3a2f978 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:34.501635 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-61477b5f-6cf9-4670-b754-e33ea3a2f978 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:34.505142 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-61477b5f-6cf9-4670-b754-e33ea3a2f978 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:34.505142 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-61477b5f-6cf9-4670-b754-e33ea3a2f978 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:34.559398 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-231f1c4c-1853-42dd-a3a9-4fd7a5a32794 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:34.566531 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-231f1c4c-1853-42dd-a3a9-4fd7a5a32794 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67" status: 200 len: 1313 microversion: 2.1 time: 0.140596 Oct 12 04:18:34.567120 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 176/337] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:34 2021] GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67 => generated 1313 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:34.690840 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-d9ad8f28-27fb-4f1d-9cd7-65b3aba65cd1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:34.691681 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-d9ad8f28-27fb-4f1d-9cd7-65b3aba65cd1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:34.697357 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d9ad8f28-27fb-4f1d-9cd7-65b3aba65cd1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:34.697816 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d9ad8f28-27fb-4f1d-9cd7-65b3aba65cd1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:34.698552 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d9ad8f28-27fb-4f1d-9cd7-65b3aba65cd1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:34.699118 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d9ad8f28-27fb-4f1d-9cd7-65b3aba65cd1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:37.185503 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-61477b5f-6cf9-4670-b754-e33ea3a2f978 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 38103 microversion: 2.1 time: 2.694798 Oct 12 04:18:37.187046 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 162/338] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:34 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 38103 bytes in 2696 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 04:18:37.190959 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-087688d1-a743-4dc3-ab6a-f085c8dc4820 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:37.191647 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-087688d1-a743-4dc3-ab6a-f085c8dc4820 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:37.197863 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-087688d1-a743-4dc3-ab6a-f085c8dc4820 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:37.198312 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-087688d1-a743-4dc3-ab6a-f085c8dc4820 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:37.199163 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-087688d1-a743-4dc3-ab6a-f085c8dc4820 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:37.199594 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-087688d1-a743-4dc3-ab6a-f085c8dc4820 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:37.205355 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-d9ad8f28-27fb-4f1d-9cd7-65b3aba65cd1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 38141 microversion: 2.20 time: 2.518117 Oct 12 04:18:37.206238 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 177/339] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:34 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 38141 bytes in 2520 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 04:18:37.212237 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-0c6ee199-6b15-4265-9022-4b2bd9ec9d47 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:37.213224 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-0c6ee199-6b15-4265-9022-4b2bd9ec9d47 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: b15c8087-3918-4533-9b51-fc4ccc0ffb67] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:37.220845 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0c6ee199-6b15-4265-9022-4b2bd9ec9d47 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:37.221410 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0c6ee199-6b15-4265-9022-4b2bd9ec9d47 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:37.222448 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0c6ee199-6b15-4265-9022-4b2bd9ec9d47 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:37.223026 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0c6ee199-6b15-4265-9022-4b2bd9ec9d47 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:37.380715 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-087688d1-a743-4dc3-ab6a-f085c8dc4820 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:37.387891 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-087688d1-a743-4dc3-ab6a-f085c8dc4820 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1521 microversion: 2.1 time: 0.200627 Oct 12 04:18:37.388448 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 163/340] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:37 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:37.393122 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-0c6ee199-6b15-4265-9022-4b2bd9ec9d47 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:37.400603 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-0c6ee199-6b15-4265-9022-4b2bd9ec9d47 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67" status: 200 len: 1313 microversion: 2.1 time: 0.192631 Oct 12 04:18:37.401184 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 178/341] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:37 2021] GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:38.197260 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-c2105cc2-42a5-4e21-8151-62b291ea7b33 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:38.198177 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-c2105cc2-42a5-4e21-8151-62b291ea7b33 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:38.204268 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c2105cc2-42a5-4e21-8151-62b291ea7b33 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:38.204745 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c2105cc2-42a5-4e21-8151-62b291ea7b33 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:38.205506 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c2105cc2-42a5-4e21-8151-62b291ea7b33 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:38.205966 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c2105cc2-42a5-4e21-8151-62b291ea7b33 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:38.216933 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-cd12c62c-becd-43c6-b004-ce18c3cbfea7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:38.217835 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-cd12c62c-becd-43c6-b004-ce18c3cbfea7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:38.224021 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-cd12c62c-becd-43c6-b004-ce18c3cbfea7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:38.224518 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-cd12c62c-becd-43c6-b004-ce18c3cbfea7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:38.225338 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-cd12c62c-becd-43c6-b004-ce18c3cbfea7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:38.225764 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-cd12c62c-becd-43c6-b004-ce18c3cbfea7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:38.307760 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-c2105cc2-42a5-4e21-8151-62b291ea7b33 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 38107 microversion: 2.1 time: 0.114065 Oct 12 04:18:38.308984 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 164/342] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:38 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 38107 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:18:38.339391 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-cd12c62c-becd-43c6-b004-ce18c3cbfea7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 38148 microversion: 2.20 time: 0.126084 Oct 12 04:18:38.340028 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 179/343] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:38 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 38148 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:18:38.405462 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-98bde895-2585-4122-990a-f5fd557083ac tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:38.406739 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-98bde895-2585-4122-990a-f5fd557083ac tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:38.412519 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-98bde895-2585-4122-990a-f5fd557083ac tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:38.412974 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-98bde895-2585-4122-990a-f5fd557083ac tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:38.413781 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-98bde895-2585-4122-990a-f5fd557083ac tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:38.414230 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-98bde895-2585-4122-990a-f5fd557083ac tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:38.417669 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-c56239f4-822d-4a40-8630-8f40ad856f17 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:38.418366 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-c56239f4-822d-4a40-8630-8f40ad856f17 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: b15c8087-3918-4533-9b51-fc4ccc0ffb67] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:38.425107 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c56239f4-822d-4a40-8630-8f40ad856f17 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:38.425540 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c56239f4-822d-4a40-8630-8f40ad856f17 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:38.426441 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c56239f4-822d-4a40-8630-8f40ad856f17 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:38.426906 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c56239f4-822d-4a40-8630-8f40ad856f17 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:38.599231 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-c56239f4-822d-4a40-8630-8f40ad856f17 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:38.604097 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-98bde895-2585-4122-990a-f5fd557083ac tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:38.606503 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-c56239f4-822d-4a40-8630-8f40ad856f17 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67" status: 200 len: 1313 microversion: 2.1 time: 0.193009 Oct 12 04:18:38.607089 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 180/344] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:38 2021] GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:38.612579 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-98bde895-2585-4122-990a-f5fd557083ac tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1521 microversion: 2.1 time: 0.211505 Oct 12 04:18:38.613127 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 165/345] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:38 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:39.320233 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-3cee2bff-a44e-467c-a56b-1fbaf5298969 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:39.321318 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-3cee2bff-a44e-467c-a56b-1fbaf5298969 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:39.327507 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3cee2bff-a44e-467c-a56b-1fbaf5298969 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:39.327962 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3cee2bff-a44e-467c-a56b-1fbaf5298969 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:39.328844 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3cee2bff-a44e-467c-a56b-1fbaf5298969 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:39.329291 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3cee2bff-a44e-467c-a56b-1fbaf5298969 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:39.351557 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-c02a579f-ac75-4020-89ae-3186c3ae8f2f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:39.352469 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-c02a579f-ac75-4020-89ae-3186c3ae8f2f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:39.358891 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c02a579f-ac75-4020-89ae-3186c3ae8f2f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:39.359587 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c02a579f-ac75-4020-89ae-3186c3ae8f2f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:39.360354 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c02a579f-ac75-4020-89ae-3186c3ae8f2f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:39.360778 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c02a579f-ac75-4020-89ae-3186c3ae8f2f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:41.933559 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-3cee2bff-a44e-467c-a56b-1fbaf5298969 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 200 len: 38233 microversion: 2.1 time: 2.616769 Oct 12 04:18:41.934203 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 181/346] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:39 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 38233 bytes in 2618 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:18:41.938995 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-59d475e2-b0b8-4694-96d2-f2253319c073 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:41.940418 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-59d475e2-b0b8-4694-96d2-f2253319c073 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: b15c8087-3918-4533-9b51-fc4ccc0ffb67] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:41.946616 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-59d475e2-b0b8-4694-96d2-f2253319c073 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:41.947091 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-59d475e2-b0b8-4694-96d2-f2253319c073 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:41.947840 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-59d475e2-b0b8-4694-96d2-f2253319c073 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:41.948270 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-59d475e2-b0b8-4694-96d2-f2253319c073 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:41.975349 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-c02a579f-ac75-4020-89ae-3186c3ae8f2f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 200 len: 38284 microversion: 2.20 time: 2.627150 Oct 12 04:18:41.975910 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 166/347] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:39 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 38284 bytes in 2629 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 04:18:41.981065 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-caf3651a-7787-415a-a798-2fdae47afe22 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:41.981775 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-caf3651a-7787-415a-a798-2fdae47afe22 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:41.988964 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-caf3651a-7787-415a-a798-2fdae47afe22 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:42.002222 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-caf3651a-7787-415a-a798-2fdae47afe22 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:42.002222 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-caf3651a-7787-415a-a798-2fdae47afe22 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:42.002222 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-caf3651a-7787-415a-a798-2fdae47afe22 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:42.091824 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-59d475e2-b0b8-4694-96d2-f2253319c073 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:42.102366 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-59d475e2-b0b8-4694-96d2-f2253319c073 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67" status: 200 len: 1313 microversion: 2.1 time: 0.166965 Oct 12 04:18:42.104560 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 182/348] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:41 2021] GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:42.118512 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-61ec942b-509e-439f-996d-d32f4d5dd0a3 req-8dd4fea7-3f07-4701-8ef5-f4fafb4f02d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b15c8087-3918-4533-9b51-fc4ccc0ffb67", "name": "network-vif-plugged", "status": "completed", "tag": "41cc2906-be10-4a86-ad90-4501c5163de7"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:42.120307 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:18:42.120307 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:18:42.129231 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-61ec942b-509e-439f-996d-d32f4d5dd0a3 req-8dd4fea7-3f07-4701-8ef5-f4fafb4f02d4 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:42.129693 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-61ec942b-509e-439f-996d-d32f4d5dd0a3 req-8dd4fea7-3f07-4701-8ef5-f4fafb4f02d4 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:42.140663 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-61ec942b-509e-439f-996d-d32f4d5dd0a3 req-8dd4fea7-3f07-4701-8ef5-f4fafb4f02d4 service nova] Creating event network-vif-plugged:41cc2906-be10-4a86-ad90-4501c5163de7 for instance b15c8087-3918-4533-9b51-fc4ccc0ffb67 on hv-cinder-81306 Oct 12 04:18:42.145342 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-61ec942b-509e-439f-996d-d32f4d5dd0a3 req-8dd4fea7-3f07-4701-8ef5-f4fafb4f02d4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039798 Oct 12 04:18:42.146147 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 183/349] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:18:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:18:42.150730 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ecde66e3-44cb-43f9-8cd1-2ecf3c90ec5e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:42.151362 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ecde66e3-44cb-43f9-8cd1-2ecf3c90ec5e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:42.157406 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ecde66e3-44cb-43f9-8cd1-2ecf3c90ec5e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:42.157859 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ecde66e3-44cb-43f9-8cd1-2ecf3c90ec5e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:42.158067 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-caf3651a-7787-415a-a798-2fdae47afe22 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:42.158720 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ecde66e3-44cb-43f9-8cd1-2ecf3c90ec5e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:42.159155 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ecde66e3-44cb-43f9-8cd1-2ecf3c90ec5e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:42.165650 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-caf3651a-7787-415a-a798-2fdae47afe22 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1521 microversion: 2.1 time: 0.188459 Oct 12 04:18:42.166219 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 167/350] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:41 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:42.176987 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-08e825f2-015a-4e5d-b22a-a3f81f79657b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:42.177628 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-08e825f2-015a-4e5d-b22a-a3f81f79657b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:42.183729 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-08e825f2-015a-4e5d-b22a-a3f81f79657b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:42.183874 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ecde66e3-44cb-43f9-8cd1-2ecf3c90ec5e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/ips" status: 200 len: 144 microversion: 2.1 time: 0.036348 Oct 12 04:18:42.184188 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-08e825f2-015a-4e5d-b22a-a3f81f79657b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:42.189669 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 184/351] 10.222.0.21 () {58 vars in 1247 bytes} [Tue Oct 12 04:18:42 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/ips => generated 144 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:18:42.189816 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-08e825f2-015a-4e5d-b22a-a3f81f79657b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:42.189816 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-08e825f2-015a-4e5d-b22a-a3f81f79657b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:42.210628 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-08e825f2-015a-4e5d-b22a-a3f81f79657b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/ips" status: 200 len: 151 microversion: 2.20 time: 0.043296 Oct 12 04:18:42.211216 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 168/352] 10.222.0.21 () {60 vars in 1288 bytes} [Tue Oct 12 04:18:42 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:18:43.121783 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-3a53037f-5071-4d4c-9352-11c7de46b934 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:43.127925 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-3a53037f-5071-4d4c-9352-11c7de46b934 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: b15c8087-3918-4533-9b51-fc4ccc0ffb67] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:43.128772 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3a53037f-5071-4d4c-9352-11c7de46b934 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:43.129264 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3a53037f-5071-4d4c-9352-11c7de46b934 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:43.130017 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3a53037f-5071-4d4c-9352-11c7de46b934 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:43.130440 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3a53037f-5071-4d4c-9352-11c7de46b934 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:43.182388 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-1124f956-f3f5-48f3-a9c2-c7044c678977 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:43.183569 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-1124f956-f3f5-48f3-a9c2-c7044c678977 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:43.190328 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1124f956-f3f5-48f3-a9c2-c7044c678977 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:43.190807 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1124f956-f3f5-48f3-a9c2-c7044c678977 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:43.194369 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1124f956-f3f5-48f3-a9c2-c7044c678977 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:43.200055 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1124f956-f3f5-48f3-a9c2-c7044c678977 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:43.296231 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-3a53037f-5071-4d4c-9352-11c7de46b934 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:43.310801 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-3a53037f-5071-4d4c-9352-11c7de46b934 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67" status: 200 len: 1313 microversion: 2.1 time: 0.187047 Oct 12 04:18:43.310801 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 185/353] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:43 2021] GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:43.356393 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-1124f956-f3f5-48f3-a9c2-c7044c678977 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:43.364548 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-1124f956-f3f5-48f3-a9c2-c7044c678977 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1521 microversion: 2.1 time: 0.185855 Oct 12 04:18:43.365103 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 169/354] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:43 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:43.603432 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-85d8db32-e304-451b-9ed0-349f3ffcd21e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5933296e-195d-4a8e-a063-75631d7cf593"}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:43.603432 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-85d8db32-e304-451b-9ed0-349f3ffcd21e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:43.612865 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-85d8db32-e304-451b-9ed0-349f3ffcd21e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:43.613517 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-85d8db32-e304-451b-9ed0-349f3ffcd21e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:43.614287 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-85d8db32-e304-451b-9ed0-349f3ffcd21e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:43.614741 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-85d8db32-e304-451b-9ed0-349f3ffcd21e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:44.134985 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.wsgi [None req-85d8db32-e304-451b-9ed0-349f3ffcd21e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] HTTP exception thrown: Invalid volume: volume 5933296e-195d-4a8e-a063-75631d7cf593 is already attached to instances: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa Oct 12 04:18:44.136299 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-85d8db32-e304-451b-9ed0-349f3ffcd21e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Returning 400 to user: Invalid volume: volume 5933296e-195d-4a8e-a063-75631d7cf593 is already attached to instances: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa {{(pid=108897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:18:44.137141 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-85d8db32-e304-451b-9ed0-349f3ffcd21e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "POST /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.539757 Oct 12 04:18:44.137692 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 186/355] 10.222.0.21 () {60 vars in 1322 bytes} [Tue Oct 12 04:18:43 2021] POST /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa/os-volume_attachments => generated 174 bytes in 541 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 04:18:44.277609 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-4547a829-ed08-432b-86fc-cfbe50465a6b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:44.278151 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-4547a829-ed08-432b-86fc-cfbe50465a6b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:44.289243 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4547a829-ed08-432b-86fc-cfbe50465a6b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:44.289243 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4547a829-ed08-432b-86fc-cfbe50465a6b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:44.290318 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4547a829-ed08-432b-86fc-cfbe50465a6b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:44.290633 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4547a829-ed08-432b-86fc-cfbe50465a6b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:44.320949 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-efee5529-0ff9-4c5b-9a46-2c0a89918662 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:44.321985 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-efee5529-0ff9-4c5b-9a46-2c0a89918662 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: b15c8087-3918-4533-9b51-fc4ccc0ffb67] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:44.329014 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-efee5529-0ff9-4c5b-9a46-2c0a89918662 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:44.329532 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-efee5529-0ff9-4c5b-9a46-2c0a89918662 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:44.330935 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-efee5529-0ff9-4c5b-9a46-2c0a89918662 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:44.331572 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-efee5529-0ff9-4c5b-9a46-2c0a89918662 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:44.434045 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.objects.instance [None req-4547a829-ed08-432b-86fc-cfbe50465a6b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lazy-loading 'services' on Instance uuid 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa {{(pid=108898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:18:44.473941 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-efee5529-0ff9-4c5b-9a46-2c0a89918662 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:44.481213 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-efee5529-0ff9-4c5b-9a46-2c0a89918662 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67" status: 200 len: 1496 microversion: 2.1 time: 0.163856 Oct 12 04:18:44.482151 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 187/356] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:44 2021] GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67 => generated 1496 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:44.486185 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-8732a1a6-0782-4abf-8a9b-c39107f65483 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:44.486849 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-8732a1a6-0782-4abf-8a9b-c39107f65483 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:44.492426 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8732a1a6-0782-4abf-8a9b-c39107f65483 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:44.492922 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8732a1a6-0782-4abf-8a9b-c39107f65483 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:44.494844 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8732a1a6-0782-4abf-8a9b-c39107f65483 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:44.495287 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8732a1a6-0782-4abf-8a9b-c39107f65483 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:44.624648 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-8732a1a6-0782-4abf-8a9b-c39107f65483 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:44.634628 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-8732a1a6-0782-4abf-8a9b-c39107f65483 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1521 microversion: 2.1 time: 0.150604 Oct 12 04:18:44.634628 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 188/357] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:44 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:44.696655 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-4547a829-ed08-432b-86fc-cfbe50465a6b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "DELETE /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa/os-volume_attachments/5933296e-195d-4a8e-a063-75631d7cf593" status: 202 len: 0 microversion: 2.1 time: 0.424584 Oct 12 04:18:44.697209 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 170/358] 10.222.0.21 () {58 vars in 1415 bytes} [Tue Oct 12 04:18:44 2021] DELETE /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa/os-volume_attachments/5933296e-195d-4a8e-a063-75631d7cf593 => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:18:44.706010 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-50467b53-0fc9-4b00-95c5-035eed1cf4dc tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:44.707008 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-50467b53-0fc9-4b00-95c5-035eed1cf4dc tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:44.712696 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-50467b53-0fc9-4b00-95c5-035eed1cf4dc tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:44.713146 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-50467b53-0fc9-4b00-95c5-035eed1cf4dc tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:44.713909 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-50467b53-0fc9-4b00-95c5-035eed1cf4dc tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:44.714342 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-50467b53-0fc9-4b00-95c5-035eed1cf4dc tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:44.744067 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-50467b53-0fc9-4b00-95c5-035eed1cf4dc tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042458 Oct 12 04:18:44.744602 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 189/359] 10.222.0.21 () {58 vars in 1301 bytes} [Tue Oct 12 04:18:44 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:18:45.268721 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d4e4d226-d649-4f86-ad8a-57f33f2502af tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:45.269584 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-d4e4d226-d649-4f86-ad8a-57f33f2502af tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:45.275942 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d4e4d226-d649-4f86-ad8a-57f33f2502af tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:45.276560 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d4e4d226-d649-4f86-ad8a-57f33f2502af tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:45.277343 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d4e4d226-d649-4f86-ad8a-57f33f2502af tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:45.277770 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d4e4d226-d649-4f86-ad8a-57f33f2502af tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:45.312506 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.objects.instance [None req-d4e4d226-d649-4f86-ad8a-57f33f2502af tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lazy-loading 'flavor' on Instance uuid 29fcfae4-9349-4167-9403-9a4a20f346bd {{(pid=108898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:18:45.649545 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-d2e811ab-1858-4237-bc89-ac63522fc8a0 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:45.650145 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-d2e811ab-1858-4237-bc89-ac63522fc8a0 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:45.656312 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d2e811ab-1858-4237-bc89-ac63522fc8a0 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:45.656810 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d2e811ab-1858-4237-bc89-ac63522fc8a0 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:45.657565 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d2e811ab-1858-4237-bc89-ac63522fc8a0 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:45.657990 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d2e811ab-1858-4237-bc89-ac63522fc8a0 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:45.793458 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-d2e811ab-1858-4237-bc89-ac63522fc8a0 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:45.800688 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-d2e811ab-1858-4237-bc89-ac63522fc8a0 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1521 microversion: 2.1 time: 0.154711 Oct 12 04:18:45.801413 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 190/360] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:45 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:45.806138 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-1d7cb021-242d-4990-8a7b-ef134f9bd96a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:45.806980 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-1d7cb021-242d-4990-8a7b-ef134f9bd96a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:45.812778 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1d7cb021-242d-4990-8a7b-ef134f9bd96a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:45.813512 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1d7cb021-242d-4990-8a7b-ef134f9bd96a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:45.814899 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1d7cb021-242d-4990-8a7b-ef134f9bd96a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:45.814899 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1d7cb021-242d-4990-8a7b-ef134f9bd96a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:45.849360 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-1d7cb021-242d-4990-8a7b-ef134f9bd96a tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046685 Oct 12 04:18:45.852159 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 191/361] 10.222.0.21 () {58 vars in 1301 bytes} [Tue Oct 12 04:18:45 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:18:45.854625 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-57070192-1fa1-4cc3-8152-db379c6d0eb2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a230c685-abb4-405f-8c09-859c6f89f3e0"}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:45.855768 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-57070192-1fa1-4cc3-8152-db379c6d0eb2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:45.861693 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-57070192-1fa1-4cc3-8152-db379c6d0eb2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:45.862155 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-57070192-1fa1-4cc3-8152-db379c6d0eb2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:45.862961 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-57070192-1fa1-4cc3-8152-db379c6d0eb2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:45.863438 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-57070192-1fa1-4cc3-8152-db379c6d0eb2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:46.014075 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-d4e4d226-d649-4f86-ad8a-57f33f2502af tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 202 len: 0 microversion: 2.20 time: 0.750368 Oct 12 04:18:46.014728 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 171/362] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:18:45 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 0 bytes in 752 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 04:18:46.021542 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d65957e6-5698-475c-95d2-0445d2bd69d1 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:46.022117 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-d65957e6-5698-475c-95d2-0445d2bd69d1 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: b15c8087-3918-4533-9b51-fc4ccc0ffb67] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:46.028592 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d65957e6-5698-475c-95d2-0445d2bd69d1 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:46.028825 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d65957e6-5698-475c-95d2-0445d2bd69d1 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:46.029595 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d65957e6-5698-475c-95d2-0445d2bd69d1 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:46.030028 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d65957e6-5698-475c-95d2-0445d2bd69d1 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:46.057903 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-d65957e6-5698-475c-95d2-0445d2bd69d1 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: b15c8087-3918-4533-9b51-fc4ccc0ffb67] Going to try to terminate instance {{(pid=108898) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 04:18:46.354509 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-d65957e6-5698-475c-95d2-0445d2bd69d1 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "DELETE /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67" status: 204 len: 0 microversion: 2.1 time: 0.338016 Oct 12 04:18:46.355795 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 172/363] 10.222.0.21 () {58 vars in 1238 bytes} [Tue Oct 12 04:18:46 2021] DELETE /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 04:18:46.361834 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-5208553a-9c0e-402e-a37e-ee09bf30f139 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:46.362592 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-5208553a-9c0e-402e-a37e-ee09bf30f139 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:46.369047 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5208553a-9c0e-402e-a37e-ee09bf30f139 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:46.369485 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5208553a-9c0e-402e-a37e-ee09bf30f139 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:46.370241 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5208553a-9c0e-402e-a37e-ee09bf30f139 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:46.370682 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5208553a-9c0e-402e-a37e-ee09bf30f139 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:46.493572 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-5208553a-9c0e-402e-a37e-ee09bf30f139 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:46.501262 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-5208553a-9c0e-402e-a37e-ee09bf30f139 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:46.503599 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-5208553a-9c0e-402e-a37e-ee09bf30f139 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:46.504787 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-5208553a-9c0e-402e-a37e-ee09bf30f139 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1722 microversion: 2.20 time: 0.147431 Oct 12 04:18:46.505331 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 173/364] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:18:46 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:18:46.509565 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-f371dcdc-cb8a-4ca3-8364-1d72d46a7e11 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:46.510152 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-f371dcdc-cb8a-4ca3-8364-1d72d46a7e11 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: b15c8087-3918-4533-9b51-fc4ccc0ffb67] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:46.515948 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f371dcdc-cb8a-4ca3-8364-1d72d46a7e11 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:46.516633 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f371dcdc-cb8a-4ca3-8364-1d72d46a7e11 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:46.517449 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f371dcdc-cb8a-4ca3-8364-1d72d46a7e11 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:46.517875 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f371dcdc-cb8a-4ca3-8364-1d72d46a7e11 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:46.639287 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-f371dcdc-cb8a-4ca3-8364-1d72d46a7e11 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:46.646537 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-f371dcdc-cb8a-4ca3-8364-1d72d46a7e11 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67" status: 200 len: 1502 microversion: 2.1 time: 0.140225 Oct 12 04:18:46.647223 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 174/365] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:46 2021] GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67 => generated 1502 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:46.817088 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-a7538b7a-e4ed-4f6b-9497-056f67cd2e5a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:46.817887 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-a7538b7a-e4ed-4f6b-9497-056f67cd2e5a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:46.824558 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a7538b7a-e4ed-4f6b-9497-056f67cd2e5a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:46.825185 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a7538b7a-e4ed-4f6b-9497-056f67cd2e5a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:46.825947 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a7538b7a-e4ed-4f6b-9497-056f67cd2e5a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:46.826367 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a7538b7a-e4ed-4f6b-9497-056f67cd2e5a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:46.949990 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-a7538b7a-e4ed-4f6b-9497-056f67cd2e5a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:46.957260 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-a7538b7a-e4ed-4f6b-9497-056f67cd2e5a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1521 microversion: 2.1 time: 0.143790 Oct 12 04:18:46.957812 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 175/366] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:46 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:46.962070 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-1bf4d778-4d0b-44dd-833d-0eea321a8b29 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:46.963140 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-1bf4d778-4d0b-44dd-833d-0eea321a8b29 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:46.968633 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1bf4d778-4d0b-44dd-833d-0eea321a8b29 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:46.969075 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1bf4d778-4d0b-44dd-833d-0eea321a8b29 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:46.969819 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1bf4d778-4d0b-44dd-833d-0eea321a8b29 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:46.970241 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1bf4d778-4d0b-44dd-833d-0eea321a8b29 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:47.000143 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-1bf4d778-4d0b-44dd-833d-0eea321a8b29 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041341 Oct 12 04:18:47.000682 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 176/367] 10.222.0.21 () {58 vars in 1301 bytes} [Tue Oct 12 04:18:46 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 04:18:47.134953 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-57070192-1fa1-4cc3-8152-db379c6d0eb2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.283602 Oct 12 04:18:47.135490 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 192/368] 10.222.0.21 () {60 vars in 1322 bytes} [Tue Oct 12 04:18:45 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/os-volume_attachments => generated 194 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:18:47.151386 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-7a89e5a6-c1b5-4024-a515-e83df4d3e2f2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-759125693", "imageRef": "bf8c5573-3890-45dc-aec8-b1ad89136f80", "flavorRef": "452", "networks": [{"uuid": "382ee370-8814-4057-bb86-a80b3c5a69fd"}]}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:47.210066 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.network.neutron [None req-7a89e5a6-c1b5-4024-a515-e83df4d3e2f2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] validate_networks() for [('382ee370-8814-4057-bb86-a80b3c5a69fd', None, None, None, None, None)] {{(pid=108898) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 04:18:47.526866 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-421a6e6c-8588-4e04-9f8d-17a5760a3276 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:47.527920 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-421a6e6c-8588-4e04-9f8d-17a5760a3276 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:47.539592 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-421a6e6c-8588-4e04-9f8d-17a5760a3276 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:47.541912 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-421a6e6c-8588-4e04-9f8d-17a5760a3276 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:47.543005 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-421a6e6c-8588-4e04-9f8d-17a5760a3276 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:47.543485 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-421a6e6c-8588-4e04-9f8d-17a5760a3276 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:47.792196 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-7a89e5a6-c1b5-4024-a515-e83df4d3e2f2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Flavor limits 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 04:18:47.792755 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-7a89e5a6-c1b5-4024-a515-e83df4d3e2f2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Image limits 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 04:18:47.793064 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-7a89e5a6-c1b5-4024-a515-e83df4d3e2f2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Flavor pref 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 04:18:47.793742 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-7a89e5a6-c1b5-4024-a515-e83df4d3e2f2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Image pref 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 04:18:47.797144 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-7a89e5a6-c1b5-4024-a515-e83df4d3e2f2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 04:18:47.807629 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-421a6e6c-8588-4e04-9f8d-17a5760a3276 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:47.821755 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7a89e5a6-c1b5-4024-a515-e83df4d3e2f2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:47.822868 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7a89e5a6-c1b5-4024-a515-e83df4d3e2f2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:47.823782 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7a89e5a6-c1b5-4024-a515-e83df4d3e2f2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:47.824160 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-421a6e6c-8588-4e04-9f8d-17a5760a3276 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:47.824775 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7a89e5a6-c1b5-4024-a515-e83df4d3e2f2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:47.826284 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-421a6e6c-8588-4e04-9f8d-17a5760a3276 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:47.828500 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-421a6e6c-8588-4e04-9f8d-17a5760a3276 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1722 microversion: 2.20 time: 0.306734 Oct 12 04:18:47.830832 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 193/369] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:18:47 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1722 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:18:47.839916 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-c2601594-af89-47fc-90d4-d7ad01e8443e tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:47.841710 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-c2601594-af89-47fc-90d4-d7ad01e8443e tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: b15c8087-3918-4533-9b51-fc4ccc0ffb67] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:47.848743 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c2601594-af89-47fc-90d4-d7ad01e8443e tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:47.849426 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c2601594-af89-47fc-90d4-d7ad01e8443e tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:47.851144 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c2601594-af89-47fc-90d4-d7ad01e8443e tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:47.851729 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c2601594-af89-47fc-90d4-d7ad01e8443e tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:47.861088 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-7a89e5a6-c1b5-4024-a515-e83df4d3e2f2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Getting quotas for project 15e19031226d475dbcf3cdfa50550ef4. Resources: {'cores', 'instances', 'ram'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:18:47.866135 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-7a89e5a6-c1b5-4024-a515-e83df4d3e2f2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Getting quotas for user e56a34c8635a4d3385b0dc3f40f469bd and project 15e19031226d475dbcf3cdfa50550ef4. Resources: {'cores', 'instances', 'ram'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:18:47.879170 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-7a89e5a6-c1b5-4024-a515-e83df4d3e2f2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Going to run 1 instances... {{(pid=108898) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 04:18:47.881459 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-7a89e5a6-c1b5-4024-a515-e83df4d3e2f2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf8c5573-3890-45dc-aec8-b1ad89136f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108898) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 04:18:47.989759 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-c2601594-af89-47fc-90d4-d7ad01e8443e tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:47.997546 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-c2601594-af89-47fc-90d4-d7ad01e8443e tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67" status: 200 len: 1502 microversion: 2.1 time: 0.165536 Oct 12 04:18:47.998100 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 194/370] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:47 2021] GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67 => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:48.011132 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-e2414d9a-9ea6-4e3e-be90-a69a9772bbd7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:48.011877 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-e2414d9a-9ea6-4e3e-be90-a69a9772bbd7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:48.019661 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e2414d9a-9ea6-4e3e-be90-a69a9772bbd7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:48.020228 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e2414d9a-9ea6-4e3e-be90-a69a9772bbd7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:48.020897 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e2414d9a-9ea6-4e3e-be90-a69a9772bbd7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:48.021329 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e2414d9a-9ea6-4e3e-be90-a69a9772bbd7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:48.044879 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-7a89e5a6-c1b5-4024-a515-e83df4d3e2f2 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.897105 Oct 12 04:18:48.045780 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 177/371] 10.222.0.21 () {60 vars in 1146 bytes} [Tue Oct 12 04:18:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 04:18:48.068316 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-ecfaf685-9a5c-4edf-b70a-ae32967b7ef7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:48.068948 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-ecfaf685-9a5c-4edf-b70a-ae32967b7ef7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:48.157243 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-ecfaf685-9a5c-4edf-b70a-ae32967b7ef7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:48.166248 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-ecfaf685-9a5c-4edf-b70a-ae32967b7ef7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1" status: 200 len: 1217 microversion: 2.1 time: 0.111403 Oct 12 04:18:48.166969 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 178/372] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:48 2021] GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 => generated 1217 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:48.330333 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-e2414d9a-9ea6-4e3e-be90-a69a9772bbd7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:48.338371 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-e2414d9a-9ea6-4e3e-be90-a69a9772bbd7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1521 microversion: 2.1 time: 0.331044 Oct 12 04:18:48.339063 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 195/373] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:47 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:48.852353 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-ff0faa74-fa47-4485-8386-2ab114447e90 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:48.857746 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-ff0faa74-fa47-4485-8386-2ab114447e90 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:48.861135 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ff0faa74-fa47-4485-8386-2ab114447e90 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:48.861845 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ff0faa74-fa47-4485-8386-2ab114447e90 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:48.871890 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ff0faa74-fa47-4485-8386-2ab114447e90 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:48.873037 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ff0faa74-fa47-4485-8386-2ab114447e90 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:49.015743 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-2a573a42-c3ff-4dfd-ac82-60bc77842c4c tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:49.016440 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-2a573a42-c3ff-4dfd-ac82-60bc77842c4c tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: b15c8087-3918-4533-9b51-fc4ccc0ffb67] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:49.023035 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2a573a42-c3ff-4dfd-ac82-60bc77842c4c tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:49.029520 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2a573a42-c3ff-4dfd-ac82-60bc77842c4c tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:49.029520 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2a573a42-c3ff-4dfd-ac82-60bc77842c4c tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:49.029520 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2a573a42-c3ff-4dfd-ac82-60bc77842c4c tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:49.048024 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-ff0faa74-fa47-4485-8386-2ab114447e90 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:49.064494 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-ff0faa74-fa47-4485-8386-2ab114447e90 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:49.064494 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-ff0faa74-fa47-4485-8386-2ab114447e90 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:49.064494 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-ff0faa74-fa47-4485-8386-2ab114447e90 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1722 microversion: 2.20 time: 0.212487 Oct 12 04:18:49.065593 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 179/374] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:18:48 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:18:49.183141 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-2a573a42-c3ff-4dfd-ac82-60bc77842c4c tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:49.185750 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-95e5b0de-f079-4fed-b84a-d0296aca9155 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:49.186773 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-95e5b0de-f079-4fed-b84a-d0296aca9155 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:49.193717 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-2a573a42-c3ff-4dfd-ac82-60bc77842c4c tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67" status: 200 len: 1460 microversion: 2.1 time: 0.181505 Oct 12 04:18:49.194404 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 196/375] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:49 2021] GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67 => generated 1460 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:49.194961 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-95e5b0de-f079-4fed-b84a-d0296aca9155 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:49.207271 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-95e5b0de-f079-4fed-b84a-d0296aca9155 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:49.207764 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-cd8c232a-2015-4200-992e-408ad54af30b req-a2b4bfdb-a3e8-4f5c-88db-e4cf49ad6eea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b15c8087-3918-4533-9b51-fc4ccc0ffb67", "name": "network-vif-deleted", "tag": "41cc2906-be10-4a86-ad90-4501c5163de7"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:49.208120 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-95e5b0de-f079-4fed-b84a-d0296aca9155 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:49.208560 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-95e5b0de-f079-4fed-b84a-d0296aca9155 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:49.210969 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:18:49.210969 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:18:49.230630 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-cd8c232a-2015-4200-992e-408ad54af30b req-a2b4bfdb-a3e8-4f5c-88db-e4cf49ad6eea service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:49.233429 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-cd8c232a-2015-4200-992e-408ad54af30b req-a2b4bfdb-a3e8-4f5c-88db-e4cf49ad6eea service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:49.282174 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-cd8c232a-2015-4200-992e-408ad54af30b req-a2b4bfdb-a3e8-4f5c-88db-e4cf49ad6eea service nova] Creating event network-vif-deleted:41cc2906-be10-4a86-ad90-4501c5163de7 for instance b15c8087-3918-4533-9b51-fc4ccc0ffb67 on hv-cinder-81306 Oct 12 04:18:49.285295 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-95e5b0de-f079-4fed-b84a-d0296aca9155 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:49.294778 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-cd8c232a-2015-4200-992e-408ad54af30b req-a2b4bfdb-a3e8-4f5c-88db-e4cf49ad6eea service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098212 Oct 12 04:18:49.295349 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-95e5b0de-f079-4fed-b84a-d0296aca9155 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1" status: 200 len: 1221 microversion: 2.1 time: 0.113874 Oct 12 04:18:49.296520 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 180/376] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:49 2021] GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 => generated 1221 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:49.299277 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 197/377] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:18:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:18:49.359512 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-674399e4-bf00-40cf-be23-e953f66d6f35 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:49.360476 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-674399e4-bf00-40cf-be23-e953f66d6f35 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:49.367303 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-674399e4-bf00-40cf-be23-e953f66d6f35 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:49.367863 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-674399e4-bf00-40cf-be23-e953f66d6f35 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:49.368791 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-674399e4-bf00-40cf-be23-e953f66d6f35 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:49.369230 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-674399e4-bf00-40cf-be23-e953f66d6f35 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:49.514236 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-674399e4-bf00-40cf-be23-e953f66d6f35 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:49.524643 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-674399e4-bf00-40cf-be23-e953f66d6f35 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1521 microversion: 2.1 time: 0.169482 Oct 12 04:18:49.525416 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 181/378] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:49 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:50.079416 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-f13705be-3fba-4aed-af38-da9cc3d8bb42 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:50.080284 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-f13705be-3fba-4aed-af38-da9cc3d8bb42 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:50.086815 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f13705be-3fba-4aed-af38-da9cc3d8bb42 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:50.093085 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f13705be-3fba-4aed-af38-da9cc3d8bb42 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:50.093085 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f13705be-3fba-4aed-af38-da9cc3d8bb42 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:50.093085 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f13705be-3fba-4aed-af38-da9cc3d8bb42 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:50.210968 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-7e98268c-bda4-4cc0-b186-67964a580173 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:50.212221 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-7e98268c-bda4-4cc0-b186-67964a580173 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: b15c8087-3918-4533-9b51-fc4ccc0ffb67] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:50.228745 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-f13705be-3fba-4aed-af38-da9cc3d8bb42 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:50.230700 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7e98268c-bda4-4cc0-b186-67964a580173 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:50.231169 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7e98268c-bda4-4cc0-b186-67964a580173 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:50.237805 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-f13705be-3fba-4aed-af38-da9cc3d8bb42 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:50.239331 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-f13705be-3fba-4aed-af38-da9cc3d8bb42 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:50.240487 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-f13705be-3fba-4aed-af38-da9cc3d8bb42 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1722 microversion: 2.20 time: 0.165679 Oct 12 04:18:50.241261 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 198/379] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:18:50 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:18:50.248820 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7e98268c-bda4-4cc0-b186-67964a580173 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:50.249516 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7e98268c-bda4-4cc0-b186-67964a580173 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:50.282959 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7e98268c-bda4-4cc0-b186-67964a580173 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:50.284156 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7e98268c-bda4-4cc0-b186-67964a580173 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:50.284612 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.objects.instance [None req-7e98268c-bda4-4cc0-b186-67964a580173 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lazy-loading 'fault' on Instance uuid b15c8087-3918-4533-9b51-fc4ccc0ffb67 {{(pid=108898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:18:50.315291 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-d0a62bfe-9887-4df4-ba28-a2c2ab653571 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:50.316459 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-d0a62bfe-9887-4df4-ba28-a2c2ab653571 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:50.329978 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d0a62bfe-9887-4df4-ba28-a2c2ab653571 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:50.331235 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d0a62bfe-9887-4df4-ba28-a2c2ab653571 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:50.337912 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d0a62bfe-9887-4df4-ba28-a2c2ab653571 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:50.337912 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d0a62bfe-9887-4df4-ba28-a2c2ab653571 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:50.342649 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-7e98268c-bda4-4cc0-b186-67964a580173 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af792a61698f4b0180f7596f9497d5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7c44417ccc40b9aa1c0a343debf9df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:50.351834 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-7e98268c-bda4-4cc0-b186-67964a580173 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67" status: 200 len: 1303 microversion: 2.1 time: 0.144341 Oct 12 04:18:50.363514 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 182/380] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:50 2021] GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67 => generated 1303 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:50.433135 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-d0a62bfe-9887-4df4-ba28-a2c2ab653571 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:50.440853 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-d0a62bfe-9887-4df4-ba28-a2c2ab653571 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1" status: 200 len: 1269 microversion: 2.1 time: 0.132327 Oct 12 04:18:50.441410 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 199/381] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:50 2021] GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 => generated 1269 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:50.541836 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-63776356-0481-4987-80ad-a0a85961fbc6 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:50.542564 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-63776356-0481-4987-80ad-a0a85961fbc6 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:50.549715 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-63776356-0481-4987-80ad-a0a85961fbc6 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:50.550149 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-63776356-0481-4987-80ad-a0a85961fbc6 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:50.551277 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-63776356-0481-4987-80ad-a0a85961fbc6 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:50.551661 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-63776356-0481-4987-80ad-a0a85961fbc6 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:50.688267 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-63776356-0481-4987-80ad-a0a85961fbc6 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:50.696303 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-63776356-0481-4987-80ad-a0a85961fbc6 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1521 microversion: 2.1 time: 0.158698 Oct 12 04:18:50.696848 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 183/382] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:50 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:51.266083 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-b28529cc-d498-4d24-9ace-525077ff14d0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:51.266083 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-b28529cc-d498-4d24-9ace-525077ff14d0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:51.271516 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b28529cc-d498-4d24-9ace-525077ff14d0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:51.274534 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b28529cc-d498-4d24-9ace-525077ff14d0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:51.278261 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b28529cc-d498-4d24-9ace-525077ff14d0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:51.278929 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b28529cc-d498-4d24-9ace-525077ff14d0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:51.370485 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-530558f1-d9b6-4f36-a1f0-922d37768d83 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:51.371253 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-530558f1-d9b6-4f36-a1f0-922d37768d83 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] [instance: b15c8087-3918-4533-9b51-fc4ccc0ffb67] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:51.378928 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-530558f1-d9b6-4f36-a1f0-922d37768d83 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:51.379898 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-530558f1-d9b6-4f36-a1f0-922d37768d83 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:51.381581 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-530558f1-d9b6-4f36-a1f0-922d37768d83 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:51.382183 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-530558f1-d9b6-4f36-a1f0-922d37768d83 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:51.402205 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.wsgi [None req-530558f1-d9b6-4f36-a1f0-922d37768d83 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] HTTP exception thrown: Instance b15c8087-3918-4533-9b51-fc4ccc0ffb67 could not be found. Oct 12 04:18:51.404328 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-530558f1-d9b6-4f36-a1f0-922d37768d83 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] Returning 404 to user: Instance b15c8087-3918-4533-9b51-fc4ccc0ffb67 could not be found. {{(pid=108898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:18:51.405409 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-530558f1-d9b6-4f36-a1f0-922d37768d83 tempest-VolumesActionsTest-1645702194 tempest-VolumesActionsTest-1645702194-project] 10.222.0.21 "GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67" status: 404 len: 111 microversion: 2.1 time: 0.040648 Oct 12 04:18:51.406553 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 184/383] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:51 2021] GET /compute/v2.1/servers/b15c8087-3918-4533-9b51-fc4ccc0ffb67 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 04:18:51.473136 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d507e892-7da4-4c92-a62b-150d7a314ee4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:51.473858 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-d507e892-7da4-4c92-a62b-150d7a314ee4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:51.484961 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d507e892-7da4-4c92-a62b-150d7a314ee4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:51.485525 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d507e892-7da4-4c92-a62b-150d7a314ee4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:51.493716 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d507e892-7da4-4c92-a62b-150d7a314ee4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:51.493716 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d507e892-7da4-4c92-a62b-150d7a314ee4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:51.505050 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-b28529cc-d498-4d24-9ace-525077ff14d0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:51.512967 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-b28529cc-d498-4d24-9ace-525077ff14d0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:51.522318 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-b28529cc-d498-4d24-9ace-525077ff14d0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:51.522318 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-b28529cc-d498-4d24-9ace-525077ff14d0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1722 microversion: 2.20 time: 0.261623 Oct 12 04:18:51.522318 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 200/384] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:18:51 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:18:51.656481 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-d507e892-7da4-4c92-a62b-150d7a314ee4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:51.671564 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-d507e892-7da4-4c92-a62b-150d7a314ee4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1" status: 200 len: 1317 microversion: 2.1 time: 0.197962 Oct 12 04:18:51.671564 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 185/385] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:51 2021] GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:51.714923 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-08218bac-84fb-4db9-b338-43f023cf657c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:51.717509 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-08218bac-84fb-4db9-b338-43f023cf657c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:51.728259 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-08218bac-84fb-4db9-b338-43f023cf657c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:51.728712 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-08218bac-84fb-4db9-b338-43f023cf657c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:51.729536 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-08218bac-84fb-4db9-b338-43f023cf657c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:51.729991 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-08218bac-84fb-4db9-b338-43f023cf657c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:51.989554 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-08218bac-84fb-4db9-b338-43f023cf657c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:51.996802 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-08218bac-84fb-4db9-b338-43f023cf657c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1521 microversion: 2.1 time: 0.287003 Oct 12 04:18:51.997362 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 201/386] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:51 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:52.547546 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-6237f89a-3c6e-46f1-b62a-f7e5ba5a8848 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:52.549511 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-6237f89a-3c6e-46f1-b62a-f7e5ba5a8848 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:52.560371 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6237f89a-3c6e-46f1-b62a-f7e5ba5a8848 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:52.560820 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6237f89a-3c6e-46f1-b62a-f7e5ba5a8848 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:52.561596 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6237f89a-3c6e-46f1-b62a-f7e5ba5a8848 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:52.562110 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6237f89a-3c6e-46f1-b62a-f7e5ba5a8848 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:52.687556 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-e102401a-b3d1-492b-87af-21965ebc18c7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:52.688163 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-e102401a-b3d1-492b-87af-21965ebc18c7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:52.703018 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e102401a-b3d1-492b-87af-21965ebc18c7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:52.703653 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e102401a-b3d1-492b-87af-21965ebc18c7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:52.704432 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e102401a-b3d1-492b-87af-21965ebc18c7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:52.704875 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e102401a-b3d1-492b-87af-21965ebc18c7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:52.811296 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-6237f89a-3c6e-46f1-b62a-f7e5ba5a8848 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:52.821507 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-6237f89a-3c6e-46f1-b62a-f7e5ba5a8848 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:52.823120 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-6237f89a-3c6e-46f1-b62a-f7e5ba5a8848 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:52.835347 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-6237f89a-3c6e-46f1-b62a-f7e5ba5a8848 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1722 microversion: 2.20 time: 0.284131 Oct 12 04:18:52.835347 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 186/387] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:18:52 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:18:52.836334 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-2c420d77-f7f3-4b99-b8ac-361c654bf5ea req-53f48d12-fa82-42ab-856c-242a7babd2f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d32dbe5f-c1a2-49d5-af68-7b63840b6fe1", "tag": "17b2b723-b4bf-43d9-a54c-66b78ab77724"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:52.838070 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:18:52.838070 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:18:52.845214 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-2c420d77-f7f3-4b99-b8ac-361c654bf5ea req-53f48d12-fa82-42ab-856c-242a7babd2f8 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:52.846353 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-2c420d77-f7f3-4b99-b8ac-361c654bf5ea req-53f48d12-fa82-42ab-856c-242a7babd2f8 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:52.858465 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-2c420d77-f7f3-4b99-b8ac-361c654bf5ea req-53f48d12-fa82-42ab-856c-242a7babd2f8 service nova] Creating event network-changed:17b2b723-b4bf-43d9-a54c-66b78ab77724 for instance d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 on hv-cinder-81306 Oct 12 04:18:52.864441 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-2c420d77-f7f3-4b99-b8ac-361c654bf5ea req-53f48d12-fa82-42ab-856c-242a7babd2f8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038229 Oct 12 04:18:52.865022 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 187/388] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:18:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:18:52.907599 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-e102401a-b3d1-492b-87af-21965ebc18c7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:52.917107 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-e102401a-b3d1-492b-87af-21965ebc18c7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1" status: 200 len: 1317 microversion: 2.1 time: 0.235746 Oct 12 04:18:52.917107 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 202/389] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:52 2021] GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:53.013901 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d68bf7f3-d21a-4106-86e9-48891b75b320 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:53.014560 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-d68bf7f3-d21a-4106-86e9-48891b75b320 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:53.022004 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d68bf7f3-d21a-4106-86e9-48891b75b320 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:53.022451 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d68bf7f3-d21a-4106-86e9-48891b75b320 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:53.024725 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d68bf7f3-d21a-4106-86e9-48891b75b320 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:53.025252 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d68bf7f3-d21a-4106-86e9-48891b75b320 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:53.237219 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-d68bf7f3-d21a-4106-86e9-48891b75b320 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:53.244760 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-d68bf7f3-d21a-4106-86e9-48891b75b320 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1501 microversion: 2.1 time: 0.234928 Oct 12 04:18:53.249743 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 188/390] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:53 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1501 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:53.261597 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-43c08e3c-9233-493b-b3a8-d7ad624a5da0 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08ecdf66-0a11-4aaa-b138-b32b3c6c59c0"}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:53.262811 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-43c08e3c-9233-493b-b3a8-d7ad624a5da0 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:53.269579 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-43c08e3c-9233-493b-b3a8-d7ad624a5da0 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:53.270025 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-43c08e3c-9233-493b-b3a8-d7ad624a5da0 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:53.270896 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-43c08e3c-9233-493b-b3a8-d7ad624a5da0 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:53.271328 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-43c08e3c-9233-493b-b3a8-d7ad624a5da0 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:53.306124 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.wsgi [None req-43c08e3c-9233-493b-b3a8-d7ad624a5da0 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] HTTP exception thrown: Cannot 'attach_volume' instance d927fdb5-40b1-4279-9f0c-7006831e05d2 while it is in vm_state rescued Oct 12 04:18:53.306745 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-43c08e3c-9233-493b-b3a8-d7ad624a5da0 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Returning 409 to user: Cannot 'attach_volume' instance d927fdb5-40b1-4279-9f0c-7006831e05d2 while it is in vm_state rescued {{(pid=108897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:18:53.307571 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-43c08e3c-9233-493b-b3a8-d7ad624a5da0 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "POST /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.050252 Oct 12 04:18:53.308302 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 203/391] 10.222.0.21 () {60 vars in 1322 bytes} [Tue Oct 12 04:18:53 2021] POST /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2/os-volume_attachments => generated 152 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 04:18:53.318437 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-f3d923cf-89fe-4ed4-a09a-7c00584c04b6 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:53.319077 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-f3d923cf-89fe-4ed4-a09a-7c00584c04b6 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:53.324950 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f3d923cf-89fe-4ed4-a09a-7c00584c04b6 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:53.325396 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f3d923cf-89fe-4ed4-a09a-7c00584c04b6 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:53.326156 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f3d923cf-89fe-4ed4-a09a-7c00584c04b6 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:53.326583 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f3d923cf-89fe-4ed4-a09a-7c00584c04b6 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:53.552602 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-f3d923cf-89fe-4ed4-a09a-7c00584c04b6 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "POST /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2/action" status: 202 len: 0 microversion: 2.1 time: 0.237183 Oct 12 04:18:53.561224 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 189/392] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:53 2021] POST /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:18:53.561572 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-3a72b079-6f56-4f4a-a41a-a9f22142fdd2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:53.562171 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-3a72b079-6f56-4f4a-a41a-a9f22142fdd2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:53.568681 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3a72b079-6f56-4f4a-a41a-a9f22142fdd2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:53.569149 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3a72b079-6f56-4f4a-a41a-a9f22142fdd2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:53.570097 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3a72b079-6f56-4f4a-a41a-a9f22142fdd2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:53.570523 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3a72b079-6f56-4f4a-a41a-a9f22142fdd2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:53.698772 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-3a72b079-6f56-4f4a-a41a-a9f22142fdd2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:53.706599 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-3a72b079-6f56-4f4a-a41a-a9f22142fdd2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1509 microversion: 2.1 time: 0.148795 Oct 12 04:18:53.707375 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 204/393] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:53 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:53.844365 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-fe904245-c969-43e8-9e82-47bb2a94abbe tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:53.845069 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-fe904245-c969-43e8-9e82-47bb2a94abbe tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:53.851077 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fe904245-c969-43e8-9e82-47bb2a94abbe tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:53.851542 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fe904245-c969-43e8-9e82-47bb2a94abbe tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:53.852293 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fe904245-c969-43e8-9e82-47bb2a94abbe tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:53.852719 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fe904245-c969-43e8-9e82-47bb2a94abbe tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:53.936188 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-391863d1-c946-4ff6-b3eb-50b650fb56ec tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:53.936712 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-391863d1-c946-4ff6-b3eb-50b650fb56ec tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:53.943104 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-391863d1-c946-4ff6-b3eb-50b650fb56ec tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:53.943552 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-391863d1-c946-4ff6-b3eb-50b650fb56ec tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:53.944315 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-391863d1-c946-4ff6-b3eb-50b650fb56ec tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:53.944746 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-391863d1-c946-4ff6-b3eb-50b650fb56ec tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:53.991711 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-fe904245-c969-43e8-9e82-47bb2a94abbe tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:53.999386 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-fe904245-c969-43e8-9e82-47bb2a94abbe tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:54.001233 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-fe904245-c969-43e8-9e82-47bb2a94abbe tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:54.003119 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-fe904245-c969-43e8-9e82-47bb2a94abbe tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1722 microversion: 2.20 time: 0.162992 Oct 12 04:18:54.003961 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 190/394] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:18:53 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:18:54.063559 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-391863d1-c946-4ff6-b3eb-50b650fb56ec tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:54.071338 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-391863d1-c946-4ff6-b3eb-50b650fb56ec tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1" status: 200 len: 1317 microversion: 2.1 time: 0.138929 Oct 12 04:18:54.071900 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 205/395] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:53 2021] GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:54.723811 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-0050a375-1e53-4ea6-aa63-82aab9e084ee tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:54.724440 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-0050a375-1e53-4ea6-aa63-82aab9e084ee tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:54.730049 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0050a375-1e53-4ea6-aa63-82aab9e084ee tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:54.730485 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0050a375-1e53-4ea6-aa63-82aab9e084ee tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:54.731279 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0050a375-1e53-4ea6-aa63-82aab9e084ee tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:54.731703 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0050a375-1e53-4ea6-aa63-82aab9e084ee tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:54.897576 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-0050a375-1e53-4ea6-aa63-82aab9e084ee tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:54.904860 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-0050a375-1e53-4ea6-aa63-82aab9e084ee tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1509 microversion: 2.1 time: 0.185207 Oct 12 04:18:54.905475 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 191/396] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:54 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:55.021679 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-a93e884d-ce5f-4174-9cf1-b978999eb744 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:55.022222 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-a93e884d-ce5f-4174-9cf1-b978999eb744 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:55.028386 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a93e884d-ce5f-4174-9cf1-b978999eb744 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:55.028833 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a93e884d-ce5f-4174-9cf1-b978999eb744 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:55.029597 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a93e884d-ce5f-4174-9cf1-b978999eb744 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:55.030029 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a93e884d-ce5f-4174-9cf1-b978999eb744 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:55.087113 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-30b8557b-4795-46ee-a0a3-e4c93340d234 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:55.088018 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-30b8557b-4795-46ee-a0a3-e4c93340d234 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:55.094312 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-30b8557b-4795-46ee-a0a3-e4c93340d234 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:55.094860 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-30b8557b-4795-46ee-a0a3-e4c93340d234 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:55.095667 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-30b8557b-4795-46ee-a0a3-e4c93340d234 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:55.096264 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-30b8557b-4795-46ee-a0a3-e4c93340d234 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:55.185928 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-a93e884d-ce5f-4174-9cf1-b978999eb744 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:55.194323 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-a93e884d-ce5f-4174-9cf1-b978999eb744 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:55.195830 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-a93e884d-ce5f-4174-9cf1-b978999eb744 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:55.196953 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-a93e884d-ce5f-4174-9cf1-b978999eb744 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1722 microversion: 2.20 time: 0.179557 Oct 12 04:18:55.197493 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 206/397] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:18:55 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:18:55.233407 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-30b8557b-4795-46ee-a0a3-e4c93340d234 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:55.240923 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-30b8557b-4795-46ee-a0a3-e4c93340d234 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1" status: 200 len: 1317 microversion: 2.1 time: 0.157444 Oct 12 04:18:55.247194 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 192/398] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:55 2021] GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:55.921704 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-520115e4-9646-40af-9382-0afb8300f63b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:55.925022 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-520115e4-9646-40af-9382-0afb8300f63b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:55.931014 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-520115e4-9646-40af-9382-0afb8300f63b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:55.931457 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-520115e4-9646-40af-9382-0afb8300f63b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:55.932217 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-520115e4-9646-40af-9382-0afb8300f63b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:55.932641 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-520115e4-9646-40af-9382-0afb8300f63b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:56.051472 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-520115e4-9646-40af-9382-0afb8300f63b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:56.058611 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-520115e4-9646-40af-9382-0afb8300f63b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1509 microversion: 2.1 time: 0.140726 Oct 12 04:18:56.059178 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 207/399] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:55 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1509 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:56.215464 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-689ce469-c21a-47e7-b4be-8307f68deec3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:56.216058 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-689ce469-c21a-47e7-b4be-8307f68deec3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:56.222303 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-689ce469-c21a-47e7-b4be-8307f68deec3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:56.222778 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-689ce469-c21a-47e7-b4be-8307f68deec3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:56.223536 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-689ce469-c21a-47e7-b4be-8307f68deec3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:56.223971 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-689ce469-c21a-47e7-b4be-8307f68deec3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:56.264070 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-069364f2-ed44-4501-8b29-ab4a714ded67 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:56.264795 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-069364f2-ed44-4501-8b29-ab4a714ded67 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:56.275497 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-069364f2-ed44-4501-8b29-ab4a714ded67 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:56.275497 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-069364f2-ed44-4501-8b29-ab4a714ded67 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:56.275497 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-069364f2-ed44-4501-8b29-ab4a714ded67 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:56.275497 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-069364f2-ed44-4501-8b29-ab4a714ded67 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:56.380082 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-689ce469-c21a-47e7-b4be-8307f68deec3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:56.390408 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-689ce469-c21a-47e7-b4be-8307f68deec3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:56.392160 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-689ce469-c21a-47e7-b4be-8307f68deec3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:56.393901 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-689ce469-c21a-47e7-b4be-8307f68deec3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1722 microversion: 2.20 time: 0.182106 Oct 12 04:18:56.394511 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 193/400] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:18:56 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:18:56.436417 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-069364f2-ed44-4501-8b29-ab4a714ded67 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:56.443652 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-069364f2-ed44-4501-8b29-ab4a714ded67 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1" status: 200 len: 1317 microversion: 2.1 time: 0.183171 Oct 12 04:18:56.450948 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 208/401] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:56 2021] GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:57.075384 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-de8f2d05-d5be-42dd-893b-7b0e9f88ddac tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:57.075980 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-de8f2d05-d5be-42dd-893b-7b0e9f88ddac tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:57.081639 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-de8f2d05-d5be-42dd-893b-7b0e9f88ddac tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:57.082099 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-de8f2d05-d5be-42dd-893b-7b0e9f88ddac tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:57.082879 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-de8f2d05-d5be-42dd-893b-7b0e9f88ddac tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:57.083306 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-de8f2d05-d5be-42dd-893b-7b0e9f88ddac tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:57.205655 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-de8f2d05-d5be-42dd-893b-7b0e9f88ddac tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:57.212886 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-de8f2d05-d5be-42dd-893b-7b0e9f88ddac tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1509 microversion: 2.1 time: 0.141061 Oct 12 04:18:57.213448 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 194/402] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:57 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1509 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:57.414565 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-abcf6a57-43b1-45ae-aca7-cc0ff7bd9d28 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:57.415353 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-abcf6a57-43b1-45ae-aca7-cc0ff7bd9d28 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:57.421493 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-abcf6a57-43b1-45ae-aca7-cc0ff7bd9d28 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:57.421932 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-abcf6a57-43b1-45ae-aca7-cc0ff7bd9d28 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:57.424429 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-abcf6a57-43b1-45ae-aca7-cc0ff7bd9d28 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:57.424429 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-abcf6a57-43b1-45ae-aca7-cc0ff7bd9d28 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:57.460274 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-92c71d7d-548d-4e68-9d83-3a1dfdc18dd6 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:57.460875 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-92c71d7d-548d-4e68-9d83-3a1dfdc18dd6 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:57.467047 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-92c71d7d-548d-4e68-9d83-3a1dfdc18dd6 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:57.467487 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-92c71d7d-548d-4e68-9d83-3a1dfdc18dd6 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:57.468255 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-92c71d7d-548d-4e68-9d83-3a1dfdc18dd6 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:57.468680 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-92c71d7d-548d-4e68-9d83-3a1dfdc18dd6 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:57.574328 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-abcf6a57-43b1-45ae-aca7-cc0ff7bd9d28 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:57.582788 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-abcf6a57-43b1-45ae-aca7-cc0ff7bd9d28 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:57.584702 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-abcf6a57-43b1-45ae-aca7-cc0ff7bd9d28 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:57.585843 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-abcf6a57-43b1-45ae-aca7-cc0ff7bd9d28 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1722 microversion: 2.20 time: 0.175833 Oct 12 04:18:57.587353 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 209/403] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:18:57 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:18:57.623602 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-92c71d7d-548d-4e68-9d83-3a1dfdc18dd6 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:57.631613 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-92c71d7d-548d-4e68-9d83-3a1dfdc18dd6 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1" status: 200 len: 1317 microversion: 2.1 time: 0.174863 Oct 12 04:18:57.632171 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 195/404] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:57 2021] GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:18:58.149501 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-da8f75dd-852c-4859-ad55-24999057b063 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:18:58.155819 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-da8f75dd-852c-4859-ad55-24999057b063 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:58.156262 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-da8f75dd-852c-4859-ad55-24999057b063 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:58.234628 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d02d8f05-430a-4271-bad0-995a41dd66b2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:58.235557 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-d02d8f05-430a-4271-bad0-995a41dd66b2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:58.243199 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d02d8f05-430a-4271-bad0-995a41dd66b2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:58.243904 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d02d8f05-430a-4271-bad0-995a41dd66b2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:58.244910 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d02d8f05-430a-4271-bad0-995a41dd66b2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:58.245452 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d02d8f05-430a-4271-bad0-995a41dd66b2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:58.269095 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-da8f75dd-852c-4859-ad55-24999057b063 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Going to try to stop instance {{(pid=108897) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 12 04:18:58.407253 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-d02d8f05-430a-4271-bad0-995a41dd66b2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:58.415516 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-d02d8f05-430a-4271-bad0-995a41dd66b2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1509 microversion: 2.1 time: 0.186701 Oct 12 04:18:58.416100 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 196/405] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:58 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1509 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:58.493068 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-da8f75dd-852c-4859-ad55-24999057b063 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 202 len: 0 microversion: 2.1 time: 0.346988 Oct 12 04:18:58.493966 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 210/406] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:18:58 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:18:58.502374 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-859d6a09-52fe-4d10-a4d7-a026a6cf74c0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:58.503005 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-859d6a09-52fe-4d10-a4d7-a026a6cf74c0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:58.512628 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-859d6a09-52fe-4d10-a4d7-a026a6cf74c0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:58.513076 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-859d6a09-52fe-4d10-a4d7-a026a6cf74c0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:58.513847 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-859d6a09-52fe-4d10-a4d7-a026a6cf74c0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:58.514242 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-859d6a09-52fe-4d10-a4d7-a026a6cf74c0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:58.606105 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-75bffc6c-6cec-4393-a9e1-7435b6309372 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:58.606885 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-75bffc6c-6cec-4393-a9e1-7435b6309372 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:58.620248 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-75bffc6c-6cec-4393-a9e1-7435b6309372 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:58.620938 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-75bffc6c-6cec-4393-a9e1-7435b6309372 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:58.621901 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-75bffc6c-6cec-4393-a9e1-7435b6309372 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:58.622580 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-75bffc6c-6cec-4393-a9e1-7435b6309372 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:58.668923 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-859d6a09-52fe-4d10-a4d7-a026a6cf74c0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:58.679298 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-859d6a09-52fe-4d10-a4d7-a026a6cf74c0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1720 microversion: 2.1 time: 0.180465 Oct 12 04:18:58.680280 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 197/407] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:58 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:58.685856 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-06723384-f55f-4c73-9764-5ea54b0d5d3e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:58.686784 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-06723384-f55f-4c73-9764-5ea54b0d5d3e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:58.694082 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-06723384-f55f-4c73-9764-5ea54b0d5d3e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:58.694948 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-06723384-f55f-4c73-9764-5ea54b0d5d3e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:58.695898 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-06723384-f55f-4c73-9764-5ea54b0d5d3e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:58.696423 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-06723384-f55f-4c73-9764-5ea54b0d5d3e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:59.152510 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-75bffc6c-6cec-4393-a9e1-7435b6309372 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:59.164004 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-75bffc6c-6cec-4393-a9e1-7435b6309372 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:59.169161 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-75bffc6c-6cec-4393-a9e1-7435b6309372 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:59.169161 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-75bffc6c-6cec-4393-a9e1-7435b6309372 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1722 microversion: 2.20 time: 0.564951 Oct 12 04:18:59.169161 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 211/408] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:18:58 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1722 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:18:59.205799 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-06723384-f55f-4c73-9764-5ea54b0d5d3e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:59.213194 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-06723384-f55f-4c73-9764-5ea54b0d5d3e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1" status: 200 len: 1317 microversion: 2.1 time: 0.531728 Oct 12 04:18:59.213927 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 198/409] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:58 2021] GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 => generated 1317 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:59.431618 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-e8b86751-5062-42c4-8c36-8340195a41f4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:59.432260 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-e8b86751-5062-42c4-8c36-8340195a41f4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:59.438099 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e8b86751-5062-42c4-8c36-8340195a41f4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:59.438548 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e8b86751-5062-42c4-8c36-8340195a41f4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:59.439886 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e8b86751-5062-42c4-8c36-8340195a41f4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:59.440333 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e8b86751-5062-42c4-8c36-8340195a41f4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:59.580257 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-e8b86751-5062-42c4-8c36-8340195a41f4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:59.588218 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-e8b86751-5062-42c4-8c36-8340195a41f4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1509 microversion: 2.1 time: 0.160123 Oct 12 04:18:59.588768 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 212/410] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:59 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:18:59.696706 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-7b13c3cf-99af-41cb-9492-fd7d304e1932 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:18:59.698114 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-7b13c3cf-99af-41cb-9492-fd7d304e1932 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:18:59.704186 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7b13c3cf-99af-41cb-9492-fd7d304e1932 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:59.704735 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7b13c3cf-99af-41cb-9492-fd7d304e1932 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:59.705502 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7b13c3cf-99af-41cb-9492-fd7d304e1932 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:18:59.706155 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7b13c3cf-99af-41cb-9492-fd7d304e1932 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:18:59.834420 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-7b13c3cf-99af-41cb-9492-fd7d304e1932 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:18:59.844950 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-7b13c3cf-99af-41cb-9492-fd7d304e1932 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1720 microversion: 2.1 time: 0.152050 Oct 12 04:18:59.856111 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 199/411] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:18:59 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:00.187035 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-36ff6f85-f997-4325-ba81-c4a2f5cd3fd7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:00.187667 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-36ff6f85-f997-4325-ba81-c4a2f5cd3fd7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:00.193836 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-36ff6f85-f997-4325-ba81-c4a2f5cd3fd7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:00.194294 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-36ff6f85-f997-4325-ba81-c4a2f5cd3fd7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:00.195089 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-36ff6f85-f997-4325-ba81-c4a2f5cd3fd7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:00.195538 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-36ff6f85-f997-4325-ba81-c4a2f5cd3fd7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:00.231089 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-71ffeca9-d35b-4a38-9c3a-93b4b7a5c0df tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:00.231690 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-71ffeca9-d35b-4a38-9c3a-93b4b7a5c0df tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:00.238723 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-71ffeca9-d35b-4a38-9c3a-93b4b7a5c0df tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:00.239460 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-71ffeca9-d35b-4a38-9c3a-93b4b7a5c0df tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:00.240639 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-71ffeca9-d35b-4a38-9c3a-93b4b7a5c0df tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:00.241264 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-71ffeca9-d35b-4a38-9c3a-93b4b7a5c0df tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:00.359169 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-36ff6f85-f997-4325-ba81-c4a2f5cd3fd7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:00.367745 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-36ff6f85-f997-4325-ba81-c4a2f5cd3fd7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:00.369448 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-36ff6f85-f997-4325-ba81-c4a2f5cd3fd7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:00.370598 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-36ff6f85-f997-4325-ba81-c4a2f5cd3fd7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1722 microversion: 2.20 time: 0.187318 Oct 12 04:19:00.371233 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 213/412] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:00 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:00.413021 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-71ffeca9-d35b-4a38-9c3a-93b4b7a5c0df tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:00.420585 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-71ffeca9-d35b-4a38-9c3a-93b4b7a5c0df tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1" status: 200 len: 1317 microversion: 2.1 time: 0.193112 Oct 12 04:19:00.421175 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 200/413] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:00 2021] GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:00.608600 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ba5d3ec0-0356-452d-a428-7e1c12a13bf5 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:00.609458 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ba5d3ec0-0356-452d-a428-7e1c12a13bf5 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:00.615499 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ba5d3ec0-0356-452d-a428-7e1c12a13bf5 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:00.615952 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ba5d3ec0-0356-452d-a428-7e1c12a13bf5 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:00.616717 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ba5d3ec0-0356-452d-a428-7e1c12a13bf5 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:00.617150 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ba5d3ec0-0356-452d-a428-7e1c12a13bf5 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:00.763879 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-ba5d3ec0-0356-452d-a428-7e1c12a13bf5 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:00.771487 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ba5d3ec0-0356-452d-a428-7e1c12a13bf5 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1509 microversion: 2.1 time: 0.167944 Oct 12 04:19:00.772131 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 214/414] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:00 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:19:00.864736 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-67ef966a-1493-465b-a8ac-4df9086c88f7 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:00.867322 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-67ef966a-1493-465b-a8ac-4df9086c88f7 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:00.875166 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-67ef966a-1493-465b-a8ac-4df9086c88f7 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:00.875686 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-67ef966a-1493-465b-a8ac-4df9086c88f7 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:00.876635 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-67ef966a-1493-465b-a8ac-4df9086c88f7 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:00.877360 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-67ef966a-1493-465b-a8ac-4df9086c88f7 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:01.021468 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-67ef966a-1493-465b-a8ac-4df9086c88f7 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:01.029240 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-67ef966a-1493-465b-a8ac-4df9086c88f7 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1720 microversion: 2.1 time: 0.169494 Oct 12 04:19:01.029877 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 201/415] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:00 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:01.391064 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-255dc1c6-f032-48cc-bc1d-96ce89bc8f24 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:01.392100 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-255dc1c6-f032-48cc-bc1d-96ce89bc8f24 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:01.400320 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-255dc1c6-f032-48cc-bc1d-96ce89bc8f24 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:01.401074 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-255dc1c6-f032-48cc-bc1d-96ce89bc8f24 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:01.402006 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-255dc1c6-f032-48cc-bc1d-96ce89bc8f24 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:01.402582 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-255dc1c6-f032-48cc-bc1d-96ce89bc8f24 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:01.437062 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-04a5098b-c7bd-4889-bd3a-edb44ca12695 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:01.438069 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-04a5098b-c7bd-4889-bd3a-edb44ca12695 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:01.444887 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-04a5098b-c7bd-4889-bd3a-edb44ca12695 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:01.445338 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-04a5098b-c7bd-4889-bd3a-edb44ca12695 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:01.446104 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-04a5098b-c7bd-4889-bd3a-edb44ca12695 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:01.446536 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-04a5098b-c7bd-4889-bd3a-edb44ca12695 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:01.571383 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-255dc1c6-f032-48cc-bc1d-96ce89bc8f24 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:01.586490 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-255dc1c6-f032-48cc-bc1d-96ce89bc8f24 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:01.588870 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-255dc1c6-f032-48cc-bc1d-96ce89bc8f24 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:01.590025 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-255dc1c6-f032-48cc-bc1d-96ce89bc8f24 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1722 microversion: 2.20 time: 0.204157 Oct 12 04:19:01.591002 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 215/416] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:01 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:01.611796 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-04a5098b-c7bd-4889-bd3a-edb44ca12695 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:01.618888 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-04a5098b-c7bd-4889-bd3a-edb44ca12695 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1" status: 200 len: 1317 microversion: 2.1 time: 0.185383 Oct 12 04:19:01.619599 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 202/417] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:01 2021] GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:19:01.790484 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-e8dcb8b9-8b67-4da8-94e2-43ebd709c073 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:01.791279 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-e8dcb8b9-8b67-4da8-94e2-43ebd709c073 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:01.799605 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e8dcb8b9-8b67-4da8-94e2-43ebd709c073 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:01.800063 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e8dcb8b9-8b67-4da8-94e2-43ebd709c073 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:01.800834 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e8dcb8b9-8b67-4da8-94e2-43ebd709c073 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:01.801262 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e8dcb8b9-8b67-4da8-94e2-43ebd709c073 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:01.940860 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-e8dcb8b9-8b67-4da8-94e2-43ebd709c073 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:01.948604 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-e8dcb8b9-8b67-4da8-94e2-43ebd709c073 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1509 microversion: 2.1 time: 0.162869 Oct 12 04:19:01.949163 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 216/418] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:01 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:02.046981 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-092eb261-d98d-4156-8041-085684da67e9 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:02.047746 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-092eb261-d98d-4156-8041-085684da67e9 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:02.054131 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-092eb261-d98d-4156-8041-085684da67e9 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:02.054641 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-092eb261-d98d-4156-8041-085684da67e9 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:02.055511 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-092eb261-d98d-4156-8041-085684da67e9 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:02.056018 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-092eb261-d98d-4156-8041-085684da67e9 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:02.189156 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-092eb261-d98d-4156-8041-085684da67e9 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:02.195407 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-092eb261-d98d-4156-8041-085684da67e9 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1720 microversion: 2.1 time: 0.151920 Oct 12 04:19:02.195964 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 203/419] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:02 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:02.610281 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-e8c3d22f-ae34-4840-82c8-c5d1b77b0c09 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:02.613885 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-e8c3d22f-ae34-4840-82c8-c5d1b77b0c09 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:02.620516 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e8c3d22f-ae34-4840-82c8-c5d1b77b0c09 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:02.621170 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e8c3d22f-ae34-4840-82c8-c5d1b77b0c09 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:02.622034 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e8c3d22f-ae34-4840-82c8-c5d1b77b0c09 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:02.622911 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e8c3d22f-ae34-4840-82c8-c5d1b77b0c09 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:02.636379 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-0067eddc-0822-4199-bde7-299b75d3f938 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:02.637244 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-0067eddc-0822-4199-bde7-299b75d3f938 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:02.644126 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0067eddc-0822-4199-bde7-299b75d3f938 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:02.644574 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0067eddc-0822-4199-bde7-299b75d3f938 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:02.645351 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0067eddc-0822-4199-bde7-299b75d3f938 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:02.645784 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0067eddc-0822-4199-bde7-299b75d3f938 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:02.804214 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-e8c3d22f-ae34-4840-82c8-c5d1b77b0c09 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:02.828320 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-0067eddc-0822-4199-bde7-299b75d3f938 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:02.830088 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-e8c3d22f-ae34-4840-82c8-c5d1b77b0c09 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:02.831910 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-e8c3d22f-ae34-4840-82c8-c5d1b77b0c09 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:02.833312 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-e8c3d22f-ae34-4840-82c8-c5d1b77b0c09 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1722 microversion: 2.20 time: 0.227703 Oct 12 04:19:02.834080 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 217/420] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:02 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:02.860895 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-0067eddc-0822-4199-bde7-299b75d3f938 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1" status: 200 len: 1317 microversion: 2.1 time: 0.227838 Oct 12 04:19:02.863109 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 204/421] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:02 2021] GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:19:03.001831 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-5991e638-a26b-4074-822e-b5e2ed85b0c9 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:03.002797 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-5991e638-a26b-4074-822e-b5e2ed85b0c9 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:03.008959 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5991e638-a26b-4074-822e-b5e2ed85b0c9 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:03.009414 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5991e638-a26b-4074-822e-b5e2ed85b0c9 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:03.010177 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5991e638-a26b-4074-822e-b5e2ed85b0c9 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:03.010803 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5991e638-a26b-4074-822e-b5e2ed85b0c9 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:03.146014 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-5991e638-a26b-4074-822e-b5e2ed85b0c9 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:03.153976 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-5991e638-a26b-4074-822e-b5e2ed85b0c9 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1509 microversion: 2.1 time: 0.155894 Oct 12 04:19:03.155581 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 218/422] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:02 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:03.213958 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-34e81022-8ff3-49d8-aebf-2b104ae230d5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:03.214486 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-34e81022-8ff3-49d8-aebf-2b104ae230d5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:03.221253 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-34e81022-8ff3-49d8-aebf-2b104ae230d5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:03.221727 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-34e81022-8ff3-49d8-aebf-2b104ae230d5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:03.222487 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-34e81022-8ff3-49d8-aebf-2b104ae230d5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:03.222961 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-34e81022-8ff3-49d8-aebf-2b104ae230d5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:03.354539 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-34e81022-8ff3-49d8-aebf-2b104ae230d5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:03.366386 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-34e81022-8ff3-49d8-aebf-2b104ae230d5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1720 microversion: 2.1 time: 0.157456 Oct 12 04:19:03.377120 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 205/423] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:03 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:03.852673 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-9dd2669e-2ead-4fa8-8728-dff73bdd40d4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:03.854658 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-9dd2669e-2ead-4fa8-8728-dff73bdd40d4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:03.860222 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9dd2669e-2ead-4fa8-8728-dff73bdd40d4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:03.860715 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9dd2669e-2ead-4fa8-8728-dff73bdd40d4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:03.861486 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9dd2669e-2ead-4fa8-8728-dff73bdd40d4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:03.861922 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9dd2669e-2ead-4fa8-8728-dff73bdd40d4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:03.881542 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-2fbba7db-1c60-4c40-96c9-29f99da4cbe9 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:03.882438 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-2fbba7db-1c60-4c40-96c9-29f99da4cbe9 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:03.889231 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2fbba7db-1c60-4c40-96c9-29f99da4cbe9 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:03.889678 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2fbba7db-1c60-4c40-96c9-29f99da4cbe9 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:03.890528 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2fbba7db-1c60-4c40-96c9-29f99da4cbe9 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:03.890994 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2fbba7db-1c60-4c40-96c9-29f99da4cbe9 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:04.088962 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-9dd2669e-2ead-4fa8-8728-dff73bdd40d4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:04.097877 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-2fbba7db-1c60-4c40-96c9-29f99da4cbe9 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:04.099767 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-9dd2669e-2ead-4fa8-8728-dff73bdd40d4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:04.101398 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-9dd2669e-2ead-4fa8-8728-dff73bdd40d4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:04.102609 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-9dd2669e-2ead-4fa8-8728-dff73bdd40d4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1722 microversion: 2.20 time: 0.253804 Oct 12 04:19:04.106965 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-2fbba7db-1c60-4c40-96c9-29f99da4cbe9 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1" status: 200 len: 1317 microversion: 2.1 time: 0.228976 Oct 12 04:19:04.111959 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 206/424] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:03 2021] GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:04.114143 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 219/425] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:03 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1722 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:04.171955 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-5e1d9d08-0fd4-4358-9f36-75107a5944c1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:04.172589 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-5e1d9d08-0fd4-4358-9f36-75107a5944c1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:04.180019 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5e1d9d08-0fd4-4358-9f36-75107a5944c1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:04.180543 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5e1d9d08-0fd4-4358-9f36-75107a5944c1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:04.181314 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5e1d9d08-0fd4-4358-9f36-75107a5944c1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:04.181939 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5e1d9d08-0fd4-4358-9f36-75107a5944c1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:04.338332 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-5e1d9d08-0fd4-4358-9f36-75107a5944c1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:04.345447 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-5e1d9d08-0fd4-4358-9f36-75107a5944c1 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1515 microversion: 2.1 time: 0.177163 Oct 12 04:19:04.346169 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 207/426] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:04 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:04.383537 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-033ca7d0-ddbf-4d0a-bf40-9bbe39e874dd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:04.384159 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-033ca7d0-ddbf-4d0a-bf40-9bbe39e874dd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:04.390420 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-033ca7d0-ddbf-4d0a-bf40-9bbe39e874dd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:04.391276 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-033ca7d0-ddbf-4d0a-bf40-9bbe39e874dd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:04.392393 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-033ca7d0-ddbf-4d0a-bf40-9bbe39e874dd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:04.393394 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-033ca7d0-ddbf-4d0a-bf40-9bbe39e874dd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:04.519959 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-033ca7d0-ddbf-4d0a-bf40-9bbe39e874dd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:04.528153 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-033ca7d0-ddbf-4d0a-bf40-9bbe39e874dd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1720 microversion: 2.1 time: 0.148314 Oct 12 04:19:04.538073 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 220/427] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:04 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:05.121780 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-c462e61d-3152-4e5c-b455-dd8d4301d894 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:05.122617 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-c462e61d-3152-4e5c-b455-dd8d4301d894 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:05.131105 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-c6f8be82-acbf-4808-be5a-5216bc71fdd4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:05.131796 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-c6f8be82-acbf-4808-be5a-5216bc71fdd4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:05.132719 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c462e61d-3152-4e5c-b455-dd8d4301d894 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:05.133528 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c462e61d-3152-4e5c-b455-dd8d4301d894 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:05.135659 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c462e61d-3152-4e5c-b455-dd8d4301d894 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:05.136771 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c462e61d-3152-4e5c-b455-dd8d4301d894 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:05.152892 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c6f8be82-acbf-4808-be5a-5216bc71fdd4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:05.153342 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c6f8be82-acbf-4808-be5a-5216bc71fdd4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:05.154124 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c6f8be82-acbf-4808-be5a-5216bc71fdd4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:05.154550 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c6f8be82-acbf-4808-be5a-5216bc71fdd4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:05.329263 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c462e61d-3152-4e5c-b455-dd8d4301d894 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:05.355950 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c462e61d-3152-4e5c-b455-dd8d4301d894 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:05.361884 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c462e61d-3152-4e5c-b455-dd8d4301d894 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:05.363344 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-c462e61d-3152-4e5c-b455-dd8d4301d894 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1722 microversion: 2.20 time: 0.245680 Oct 12 04:19:05.367680 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 208/428] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:05 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:05.374839 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-1b7a8f76-a392-4c3c-8535-98a5c2598e91 req-695b13bb-82e7-408c-933b-531c67423e7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d32dbe5f-c1a2-49d5-af68-7b63840b6fe1", "name": "network-vif-plugged", "status": "completed", "tag": "17b2b723-b4bf-43d9-a54c-66b78ab77724"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:19:05.377665 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:19:05.377665 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:19:05.400929 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-1b7a8f76-a392-4c3c-8535-98a5c2598e91 req-695b13bb-82e7-408c-933b-531c67423e7d service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:05.401711 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-1b7a8f76-a392-4c3c-8535-98a5c2598e91 req-695b13bb-82e7-408c-933b-531c67423e7d service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:05.408876 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-c6f8be82-acbf-4808-be5a-5216bc71fdd4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:05.417256 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-c6f8be82-acbf-4808-be5a-5216bc71fdd4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1" status: 200 len: 1317 microversion: 2.1 time: 0.292759 Oct 12 04:19:05.420306 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-1b7a8f76-a392-4c3c-8535-98a5c2598e91 req-695b13bb-82e7-408c-933b-531c67423e7d service nova] Creating event network-vif-plugged:17b2b723-b4bf-43d9-a54c-66b78ab77724 for instance d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 on hv-cinder-81306 Oct 12 04:19:05.427260 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 221/429] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:05 2021] GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:05.428680 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-1b7a8f76-a392-4c3c-8535-98a5c2598e91 req-695b13bb-82e7-408c-933b-531c67423e7d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058740 Oct 12 04:19:05.429646 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 209/430] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:19:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:19:05.545381 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-2fac3a7e-09f9-43b0-819a-8a79b4192e61 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:05.545767 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-2fac3a7e-09f9-43b0-819a-8a79b4192e61 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:05.552344 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2fac3a7e-09f9-43b0-819a-8a79b4192e61 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:05.552726 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2fac3a7e-09f9-43b0-819a-8a79b4192e61 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:05.553500 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2fac3a7e-09f9-43b0-819a-8a79b4192e61 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:05.553931 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2fac3a7e-09f9-43b0-819a-8a79b4192e61 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:05.714345 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-2fac3a7e-09f9-43b0-819a-8a79b4192e61 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:05.725813 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-2fac3a7e-09f9-43b0-819a-8a79b4192e61 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1720 microversion: 2.1 time: 0.184378 Oct 12 04:19:05.727142 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 222/431] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:05 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:06.008969 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-2985fb6a-0e1a-4427-b1c0-8c1547d9bb04 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:06.009775 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-2985fb6a-0e1a-4427-b1c0-8c1547d9bb04 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:06.016761 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2985fb6a-0e1a-4427-b1c0-8c1547d9bb04 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:06.017216 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2985fb6a-0e1a-4427-b1c0-8c1547d9bb04 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:06.017980 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2985fb6a-0e1a-4427-b1c0-8c1547d9bb04 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:06.018402 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2985fb6a-0e1a-4427-b1c0-8c1547d9bb04 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:06.150817 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-2985fb6a-0e1a-4427-b1c0-8c1547d9bb04 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:06.158989 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-2985fb6a-0e1a-4427-b1c0-8c1547d9bb04 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1515 microversion: 2.1 time: 0.154984 Oct 12 04:19:06.159669 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 210/432] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:06 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:06.175810 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-c1a11333-e0a4-42be-a3e0-a0fe5190977c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20bbc5f8-5aa7-493a-8d35-95a441725c6c"}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:19:06.176939 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-c1a11333-e0a4-42be-a3e0-a0fe5190977c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:06.182876 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c1a11333-e0a4-42be-a3e0-a0fe5190977c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:06.183327 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c1a11333-e0a4-42be-a3e0-a0fe5190977c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:06.184175 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c1a11333-e0a4-42be-a3e0-a0fe5190977c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:06.184518 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c1a11333-e0a4-42be-a3e0-a0fe5190977c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:06.383863 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-2cdef44c-2597-495d-a265-729c2f241266 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:06.385025 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-2cdef44c-2597-495d-a265-729c2f241266 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:06.391304 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2cdef44c-2597-495d-a265-729c2f241266 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:06.391754 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2cdef44c-2597-495d-a265-729c2f241266 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:06.393085 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2cdef44c-2597-495d-a265-729c2f241266 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:06.393944 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2cdef44c-2597-495d-a265-729c2f241266 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:06.526400 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-2cdef44c-2597-495d-a265-729c2f241266 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:06.544457 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-2cdef44c-2597-495d-a265-729c2f241266 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:06.544457 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-2cdef44c-2597-495d-a265-729c2f241266 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:06.552008 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-2cdef44c-2597-495d-a265-729c2f241266 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1722 microversion: 2.20 time: 0.165074 Oct 12 04:19:06.563292 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 211/433] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:06 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:19:06.572735 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-09262a8f-8806-4603-9fb2-8367307d1852 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:06.574340 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-09262a8f-8806-4603-9fb2-8367307d1852 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:06.590940 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-09262a8f-8806-4603-9fb2-8367307d1852 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:06.591796 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-09262a8f-8806-4603-9fb2-8367307d1852 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:06.593283 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-09262a8f-8806-4603-9fb2-8367307d1852 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:06.594089 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-09262a8f-8806-4603-9fb2-8367307d1852 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:06.829112 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-09262a8f-8806-4603-9fb2-8367307d1852 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:06.839835 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-09262a8f-8806-4603-9fb2-8367307d1852 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1" status: 200 len: 1317 microversion: 2.1 time: 0.283444 Oct 12 04:19:06.843499 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 212/434] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:06 2021] GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:06.853694 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-f5ba4d2d-43d2-4a01-83f0-82d2a5ab4d75 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:06.854559 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-f5ba4d2d-43d2-4a01-83f0-82d2a5ab4d75 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:06.861903 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f5ba4d2d-43d2-4a01-83f0-82d2a5ab4d75 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:06.862424 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f5ba4d2d-43d2-4a01-83f0-82d2a5ab4d75 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:06.863282 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f5ba4d2d-43d2-4a01-83f0-82d2a5ab4d75 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:06.863955 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f5ba4d2d-43d2-4a01-83f0-82d2a5ab4d75 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:07.030921 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-c1a11333-e0a4-42be-a3e0-a0fe5190977c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "POST /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.858628 Oct 12 04:19:07.034119 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 223/435] 10.222.0.21 () {60 vars in 1322 bytes} [Tue Oct 12 04:19:06 2021] POST /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2/os-volume_attachments => generated 194 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:19:07.087293 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-f5ba4d2d-43d2-4a01-83f0-82d2a5ab4d75 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:07.098913 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-f5ba4d2d-43d2-4a01-83f0-82d2a5ab4d75 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1720 microversion: 2.1 time: 0.248739 Oct 12 04:19:07.101472 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 213/436] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:06 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1720 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:07.574401 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-4349fbb3-a2dc-43eb-a876-e99ba7b6e626 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:07.575655 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-4349fbb3-a2dc-43eb-a876-e99ba7b6e626 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:07.590688 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4349fbb3-a2dc-43eb-a876-e99ba7b6e626 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:07.591840 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4349fbb3-a2dc-43eb-a876-e99ba7b6e626 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:07.593584 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4349fbb3-a2dc-43eb-a876-e99ba7b6e626 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:07.594347 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4349fbb3-a2dc-43eb-a876-e99ba7b6e626 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:07.827479 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-4349fbb3-a2dc-43eb-a876-e99ba7b6e626 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:07.842156 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-4349fbb3-a2dc-43eb-a876-e99ba7b6e626 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:07.843789 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-4349fbb3-a2dc-43eb-a876-e99ba7b6e626 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:07.845018 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-4349fbb3-a2dc-43eb-a876-e99ba7b6e626 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1743 microversion: 2.20 time: 0.277109 Oct 12 04:19:07.859936 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 224/437] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:07 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1743 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:07.865433 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-49ef7d3c-2424-4865-95ac-ed2a4dc778ec tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:07.866448 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-49ef7d3c-2424-4865-95ac-ed2a4dc778ec tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:07.873419 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-49ef7d3c-2424-4865-95ac-ed2a4dc778ec tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:07.873995 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-49ef7d3c-2424-4865-95ac-ed2a4dc778ec tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:07.874987 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-49ef7d3c-2424-4865-95ac-ed2a4dc778ec tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:07.875593 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-49ef7d3c-2424-4865-95ac-ed2a4dc778ec tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:08.077966 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-49ef7d3c-2424-4865-95ac-ed2a4dc778ec tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:08.087092 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-49ef7d3c-2424-4865-95ac-ed2a4dc778ec tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1" status: 200 len: 1507 microversion: 2.1 time: 0.232133 Oct 12 04:19:08.088069 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 214/438] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:07 2021] GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 => generated 1507 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:19:08.118197 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-c53446b1-a8d1-44e8-bb6b-b0ec87c9853d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:08.118852 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-c53446b1-a8d1-44e8-bb6b-b0ec87c9853d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:08.124834 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c53446b1-a8d1-44e8-bb6b-b0ec87c9853d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:08.125310 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c53446b1-a8d1-44e8-bb6b-b0ec87c9853d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:08.126114 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c53446b1-a8d1-44e8-bb6b-b0ec87c9853d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:08.126574 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c53446b1-a8d1-44e8-bb6b-b0ec87c9853d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:08.340545 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-c53446b1-a8d1-44e8-bb6b-b0ec87c9853d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:08.351545 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-c53446b1-a8d1-44e8-bb6b-b0ec87c9853d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1720 microversion: 2.1 time: 0.237447 Oct 12 04:19:08.366013 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 225/439] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:08 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1720 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:08.867578 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-c85f2c55-0169-4d5e-94f9-3e4a07d982a5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:08.869041 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-c85f2c55-0169-4d5e-94f9-3e4a07d982a5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:08.874926 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c85f2c55-0169-4d5e-94f9-3e4a07d982a5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:08.875573 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c85f2c55-0169-4d5e-94f9-3e4a07d982a5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:08.876359 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c85f2c55-0169-4d5e-94f9-3e4a07d982a5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:08.877453 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c85f2c55-0169-4d5e-94f9-3e4a07d982a5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:09.073352 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c85f2c55-0169-4d5e-94f9-3e4a07d982a5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:09.087001 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c85f2c55-0169-4d5e-94f9-3e4a07d982a5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:09.089064 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c85f2c55-0169-4d5e-94f9-3e4a07d982a5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:09.090318 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-c85f2c55-0169-4d5e-94f9-3e4a07d982a5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1743 microversion: 2.20 time: 0.226439 Oct 12 04:19:09.103517 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 215/440] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:08 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1743 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:09.371276 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-10bffea0-daba-4fe7-8364-7cc713581418 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:09.372224 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-10bffea0-daba-4fe7-8364-7cc713581418 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:09.378578 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-10bffea0-daba-4fe7-8364-7cc713581418 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:09.379055 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-10bffea0-daba-4fe7-8364-7cc713581418 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:09.379819 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-10bffea0-daba-4fe7-8364-7cc713581418 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:09.380243 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-10bffea0-daba-4fe7-8364-7cc713581418 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:09.531832 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-10bffea0-daba-4fe7-8364-7cc713581418 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:09.540204 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-10bffea0-daba-4fe7-8364-7cc713581418 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1720 microversion: 2.1 time: 0.172601 Oct 12 04:19:09.540766 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 226/441] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:09 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:19:09.918390 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-fae74425-6a22-44e9-a38f-e90f451ee41d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2a19ecd-192e-4c3a-bba4-f9ce7902e897"}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:19:09.919531 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-fae74425-6a22-44e9-a38f-e90f451ee41d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:09.925439 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fae74425-6a22-44e9-a38f-e90f451ee41d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:09.925882 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fae74425-6a22-44e9-a38f-e90f451ee41d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:09.926638 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fae74425-6a22-44e9-a38f-e90f451ee41d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:09.927088 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fae74425-6a22-44e9-a38f-e90f451ee41d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:10.115048 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-eec03fd9-ffd6-4c13-820d-249d12c79ae0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:10.115747 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-eec03fd9-ffd6-4c13-820d-249d12c79ae0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:10.125142 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-eec03fd9-ffd6-4c13-820d-249d12c79ae0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:10.125795 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-eec03fd9-ffd6-4c13-820d-249d12c79ae0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:10.126438 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-eec03fd9-ffd6-4c13-820d-249d12c79ae0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:10.133627 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-eec03fd9-ffd6-4c13-820d-249d12c79ae0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:10.337498 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-eec03fd9-ffd6-4c13-820d-249d12c79ae0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:10.346004 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-eec03fd9-ffd6-4c13-820d-249d12c79ae0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:10.348377 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-eec03fd9-ffd6-4c13-820d-249d12c79ae0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:10.350835 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-eec03fd9-ffd6-4c13-820d-249d12c79ae0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1743 microversion: 2.20 time: 0.239451 Oct 12 04:19:10.350835 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 227/442] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:10 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1743 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:10.557221 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-e7d5c977-70fb-4d90-a342-0e2216be87b3 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:10.557875 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-e7d5c977-70fb-4d90-a342-0e2216be87b3 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:10.565051 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e7d5c977-70fb-4d90-a342-0e2216be87b3 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:10.565772 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e7d5c977-70fb-4d90-a342-0e2216be87b3 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:10.566776 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e7d5c977-70fb-4d90-a342-0e2216be87b3 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:10.567423 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e7d5c977-70fb-4d90-a342-0e2216be87b3 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:10.722916 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-fae74425-6a22-44e9-a38f-e90f451ee41d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "POST /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.797969 Oct 12 04:19:10.722916 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 216/443] 10.222.0.21 () {60 vars in 1322 bytes} [Tue Oct 12 04:19:09 2021] POST /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1/os-volume_attachments => generated 194 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:19:10.792156 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-e7d5c977-70fb-4d90-a342-0e2216be87b3 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:10.801914 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-e7d5c977-70fb-4d90-a342-0e2216be87b3 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1720 microversion: 2.1 time: 0.248392 Oct 12 04:19:10.803785 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 228/444] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:10 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1720 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:11.159437 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-f51c57d6-9de8-4108-98b5-2f97f221d715 req-80e05885-34a2-48af-b4e9-2ee5784f1c54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29fcfae4-9349-4167-9403-9a4a20f346bd", "name": "network-vif-plugged", "status": "completed", "tag": "c5a9a497-7d69-4ed5-85cb-fa9a1cc1b4bf"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:19:11.161440 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:19:11.161440 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:19:11.172997 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-f51c57d6-9de8-4108-98b5-2f97f221d715 req-80e05885-34a2-48af-b4e9-2ee5784f1c54 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:11.174275 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-f51c57d6-9de8-4108-98b5-2f97f221d715 req-80e05885-34a2-48af-b4e9-2ee5784f1c54 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:11.192545 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-f51c57d6-9de8-4108-98b5-2f97f221d715 req-80e05885-34a2-48af-b4e9-2ee5784f1c54 service nova] Creating event network-vif-plugged:c5a9a497-7d69-4ed5-85cb-fa9a1cc1b4bf for instance 29fcfae4-9349-4167-9403-9a4a20f346bd on hv-cinder-81306 Oct 12 04:19:11.197858 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-f51c57d6-9de8-4108-98b5-2f97f221d715 req-80e05885-34a2-48af-b4e9-2ee5784f1c54 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046907 Oct 12 04:19:11.201876 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 217/445] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:19:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:19:11.374171 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-12364df8-c8d3-4366-bb93-d760fbabb198 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:11.374171 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-12364df8-c8d3-4366-bb93-d760fbabb198 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:11.386411 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-12364df8-c8d3-4366-bb93-d760fbabb198 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:11.386955 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-12364df8-c8d3-4366-bb93-d760fbabb198 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:11.387992 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-12364df8-c8d3-4366-bb93-d760fbabb198 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:11.388955 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-12364df8-c8d3-4366-bb93-d760fbabb198 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:11.642446 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-12364df8-c8d3-4366-bb93-d760fbabb198 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:11.652613 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-12364df8-c8d3-4366-bb93-d760fbabb198 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:11.654485 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-12364df8-c8d3-4366-bb93-d760fbabb198 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:11.655893 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-12364df8-c8d3-4366-bb93-d760fbabb198 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1738 microversion: 2.20 time: 0.290498 Oct 12 04:19:11.657056 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 229/446] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:11 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1738 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:11.821726 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-818dbb58-14ec-49b4-851d-28c0933cbb76 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:11.822704 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-818dbb58-14ec-49b4-851d-28c0933cbb76 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:11.844236 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-818dbb58-14ec-49b4-851d-28c0933cbb76 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:11.851482 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-818dbb58-14ec-49b4-851d-28c0933cbb76 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:11.852847 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-818dbb58-14ec-49b4-851d-28c0933cbb76 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:11.857619 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-818dbb58-14ec-49b4-851d-28c0933cbb76 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:12.095940 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-818dbb58-14ec-49b4-851d-28c0933cbb76 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:12.105692 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-818dbb58-14ec-49b4-851d-28c0933cbb76 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1720 microversion: 2.1 time: 0.289195 Oct 12 04:19:12.106397 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 218/447] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:11 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1720 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:12.676226 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-46b6c74c-3544-4f91-81ca-679a9c301c92 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:12.681224 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-46b6c74c-3544-4f91-81ca-679a9c301c92 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:12.688896 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-46b6c74c-3544-4f91-81ca-679a9c301c92 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:12.689616 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-46b6c74c-3544-4f91-81ca-679a9c301c92 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:12.691246 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-46b6c74c-3544-4f91-81ca-679a9c301c92 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:12.691894 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-46b6c74c-3544-4f91-81ca-679a9c301c92 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:12.890109 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-46b6c74c-3544-4f91-81ca-679a9c301c92 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:12.902168 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-46b6c74c-3544-4f91-81ca-679a9c301c92 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:12.907328 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-46b6c74c-3544-4f91-81ca-679a9c301c92 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:12.912810 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-46b6c74c-3544-4f91-81ca-679a9c301c92 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1738 microversion: 2.20 time: 0.237986 Oct 12 04:19:12.912810 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 230/448] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:12 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1738 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:13.149008 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-0fdbf2bc-51aa-4ce4-9007-19dfb925eb97 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:13.149789 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-0fdbf2bc-51aa-4ce4-9007-19dfb925eb97 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:13.171753 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0fdbf2bc-51aa-4ce4-9007-19dfb925eb97 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:13.172377 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0fdbf2bc-51aa-4ce4-9007-19dfb925eb97 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:13.174264 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0fdbf2bc-51aa-4ce4-9007-19dfb925eb97 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:13.178136 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0fdbf2bc-51aa-4ce4-9007-19dfb925eb97 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:13.477228 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-0fdbf2bc-51aa-4ce4-9007-19dfb925eb97 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:13.485569 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-0fdbf2bc-51aa-4ce4-9007-19dfb925eb97 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1720 microversion: 2.1 time: 0.365513 Oct 12 04:19:13.495854 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 219/449] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:13 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1720 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:13.929230 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-4fcd1e84-1287-4162-84c5-b60d65be42a4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:13.930568 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-4fcd1e84-1287-4162-84c5-b60d65be42a4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:13.943358 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4fcd1e84-1287-4162-84c5-b60d65be42a4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:13.944184 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4fcd1e84-1287-4162-84c5-b60d65be42a4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:13.953066 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4fcd1e84-1287-4162-84c5-b60d65be42a4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:13.953738 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4fcd1e84-1287-4162-84c5-b60d65be42a4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:14.156690 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-4fcd1e84-1287-4162-84c5-b60d65be42a4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:14.167148 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-4fcd1e84-1287-4162-84c5-b60d65be42a4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:14.171860 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-4fcd1e84-1287-4162-84c5-b60d65be42a4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:14.173785 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-4fcd1e84-1287-4162-84c5-b60d65be42a4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1738 microversion: 2.20 time: 0.247636 Oct 12 04:19:14.174799 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 231/450] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:13 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1738 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:14.505187 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-b77892de-34fc-492d-b750-923de3c7583f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:14.506579 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-b77892de-34fc-492d-b750-923de3c7583f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:14.525539 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b77892de-34fc-492d-b750-923de3c7583f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:14.527253 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b77892de-34fc-492d-b750-923de3c7583f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:14.537223 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b77892de-34fc-492d-b750-923de3c7583f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:14.538109 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b77892de-34fc-492d-b750-923de3c7583f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:14.787691 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-b77892de-34fc-492d-b750-923de3c7583f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:14.799824 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-b77892de-34fc-492d-b750-923de3c7583f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1720 microversion: 2.1 time: 0.299312 Oct 12 04:19:14.800404 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 220/451] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:14 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1720 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:15.193912 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-50959f68-e478-45cd-a577-d4d3366e8206 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:15.195650 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-50959f68-e478-45cd-a577-d4d3366e8206 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:15.204208 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-50959f68-e478-45cd-a577-d4d3366e8206 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:15.205302 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-50959f68-e478-45cd-a577-d4d3366e8206 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:15.206329 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-50959f68-e478-45cd-a577-d4d3366e8206 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:15.206992 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-50959f68-e478-45cd-a577-d4d3366e8206 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:15.503494 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-50959f68-e478-45cd-a577-d4d3366e8206 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:15.512094 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-50959f68-e478-45cd-a577-d4d3366e8206 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:15.513624 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-50959f68-e478-45cd-a577-d4d3366e8206 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:15.514898 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-50959f68-e478-45cd-a577-d4d3366e8206 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1738 microversion: 2.20 time: 0.326859 Oct 12 04:19:15.515440 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 232/452] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:15 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1738 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:15.818256 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-a46301a8-a207-4f50-850d-b4c9dba46bfa tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:15.819906 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-a46301a8-a207-4f50-850d-b4c9dba46bfa tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:15.826620 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a46301a8-a207-4f50-850d-b4c9dba46bfa tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:15.831371 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a46301a8-a207-4f50-850d-b4c9dba46bfa tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:15.831371 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a46301a8-a207-4f50-850d-b4c9dba46bfa tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:15.831371 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a46301a8-a207-4f50-850d-b4c9dba46bfa tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:15.915233 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-f9d06a3a-8787-4898-b965-6d2bc4cb01bd tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:19:15.916792 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-f9d06a3a-8787-4898-b965-6d2bc4cb01bd tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:15.931043 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f9d06a3a-8787-4898-b965-6d2bc4cb01bd tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:15.931911 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f9d06a3a-8787-4898-b965-6d2bc4cb01bd tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:15.932928 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f9d06a3a-8787-4898-b965-6d2bc4cb01bd tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:15.933510 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f9d06a3a-8787-4898-b965-6d2bc4cb01bd tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:15.984189 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.objects.instance [None req-f9d06a3a-8787-4898-b965-6d2bc4cb01bd tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lazy-loading 'flavor' on Instance uuid d927fdb5-40b1-4279-9f0c-7006831e05d2 {{(pid=108897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:19:16.092251 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-a46301a8-a207-4f50-850d-b4c9dba46bfa tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:16.102539 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-a46301a8-a207-4f50-850d-b4c9dba46bfa tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1720 microversion: 2.1 time: 0.288604 Oct 12 04:19:16.114215 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 221/453] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:15 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1720 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:16.396854 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-f9d06a3a-8787-4898-b965-6d2bc4cb01bd tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "POST /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2/action" status: 200 len: 32 microversion: 2.1 time: 0.485449 Oct 12 04:19:16.399428 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 233/454] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:19:15 2021] POST /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2/action => generated 32 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 04:19:16.409616 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-4266d122-fad7-4f0f-8792-982958b2c28f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:16.419875 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-4266d122-fad7-4f0f-8792-982958b2c28f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:16.438967 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4266d122-fad7-4f0f-8792-982958b2c28f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:16.441053 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4266d122-fad7-4f0f-8792-982958b2c28f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:16.443822 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4266d122-fad7-4f0f-8792-982958b2c28f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:16.445774 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4266d122-fad7-4f0f-8792-982958b2c28f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:16.537118 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-973fb00b-318b-44b4-837c-414051153190 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:16.538084 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-973fb00b-318b-44b4-837c-414051153190 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:16.573062 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-973fb00b-318b-44b4-837c-414051153190 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:16.574038 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-973fb00b-318b-44b4-837c-414051153190 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:16.577126 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-973fb00b-318b-44b4-837c-414051153190 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:16.579258 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-973fb00b-318b-44b4-837c-414051153190 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:16.801418 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-4266d122-fad7-4f0f-8792-982958b2c28f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:16.813134 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-4266d122-fad7-4f0f-8792-982958b2c28f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.408878 Oct 12 04:19:16.821705 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 222/455] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:16 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:16.989516 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-973fb00b-318b-44b4-837c-414051153190 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:16.998921 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-973fb00b-318b-44b4-837c-414051153190 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:17.006213 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-973fb00b-318b-44b4-837c-414051153190 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:17.007700 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-973fb00b-318b-44b4-837c-414051153190 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1738 microversion: 2.20 time: 0.478010 Oct 12 04:19:17.008791 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 234/456] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:16 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1738 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:19:17.120797 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-8a6018d9-a72a-484d-ada4-17f401e53b2b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:17.123240 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-8a6018d9-a72a-484d-ada4-17f401e53b2b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:17.139035 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8a6018d9-a72a-484d-ada4-17f401e53b2b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:17.139762 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8a6018d9-a72a-484d-ada4-17f401e53b2b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:17.140716 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8a6018d9-a72a-484d-ada4-17f401e53b2b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:17.141307 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8a6018d9-a72a-484d-ada4-17f401e53b2b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:17.427976 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-8a6018d9-a72a-484d-ada4-17f401e53b2b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:17.436714 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-8a6018d9-a72a-484d-ada4-17f401e53b2b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1720 microversion: 2.1 time: 0.319794 Oct 12 04:19:17.451507 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 223/457] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:17 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1720 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:17.836463 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-99d18e22-c09d-467a-a775-8f7d1cd7bb1d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:17.837810 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-99d18e22-c09d-467a-a775-8f7d1cd7bb1d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:17.844168 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-99d18e22-c09d-467a-a775-8f7d1cd7bb1d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:17.844952 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-99d18e22-c09d-467a-a775-8f7d1cd7bb1d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:17.846612 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-99d18e22-c09d-467a-a775-8f7d1cd7bb1d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:17.847497 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-99d18e22-c09d-467a-a775-8f7d1cd7bb1d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:18.028589 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-c5efa473-75c8-420d-8ef7-31e4396fe732 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:18.030097 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-c5efa473-75c8-420d-8ef7-31e4396fe732 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:18.047289 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c5efa473-75c8-420d-8ef7-31e4396fe732 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:18.047777 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c5efa473-75c8-420d-8ef7-31e4396fe732 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:18.048611 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c5efa473-75c8-420d-8ef7-31e4396fe732 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:18.049566 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c5efa473-75c8-420d-8ef7-31e4396fe732 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:18.107917 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-99d18e22-c09d-467a-a775-8f7d1cd7bb1d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:18.123273 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-99d18e22-c09d-467a-a775-8f7d1cd7bb1d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.291000 Oct 12 04:19:18.129143 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 235/458] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:17 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:18.249476 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c5efa473-75c8-420d-8ef7-31e4396fe732 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:18.280722 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c5efa473-75c8-420d-8ef7-31e4396fe732 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:18.282831 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c5efa473-75c8-420d-8ef7-31e4396fe732 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:18.284762 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-c5efa473-75c8-420d-8ef7-31e4396fe732 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1738 microversion: 2.20 time: 0.261949 Oct 12 04:19:18.285885 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 224/459] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:18 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1738 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:19:18.457481 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-0c4e50e8-6264-4935-a217-89db2cf5cf00 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:18.458018 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-0c4e50e8-6264-4935-a217-89db2cf5cf00 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:18.464147 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0c4e50e8-6264-4935-a217-89db2cf5cf00 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:18.464591 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0c4e50e8-6264-4935-a217-89db2cf5cf00 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:18.465384 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0c4e50e8-6264-4935-a217-89db2cf5cf00 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:18.465795 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0c4e50e8-6264-4935-a217-89db2cf5cf00 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:18.619592 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-0c4e50e8-6264-4935-a217-89db2cf5cf00 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:18.627826 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-0c4e50e8-6264-4935-a217-89db2cf5cf00 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1720 microversion: 2.1 time: 0.174392 Oct 12 04:19:18.628498 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 236/460] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:18 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1720 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:19.147022 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-9f8eb057-e69e-43ac-aef3-acb5f8e0f9c0 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:19.147022 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-9f8eb057-e69e-43ac-aef3-acb5f8e0f9c0 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:19.148184 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9f8eb057-e69e-43ac-aef3-acb5f8e0f9c0 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:19.148662 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9f8eb057-e69e-43ac-aef3-acb5f8e0f9c0 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:19.149427 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9f8eb057-e69e-43ac-aef3-acb5f8e0f9c0 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:19.149850 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9f8eb057-e69e-43ac-aef3-acb5f8e0f9c0 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:19.311633 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-d420cebe-64a3-4444-87c1-32903743750e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:19.312542 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-d420cebe-64a3-4444-87c1-32903743750e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:19.316910 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-9f8eb057-e69e-43ac-aef3-acb5f8e0f9c0 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:19.326316 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-9f8eb057-e69e-43ac-aef3-acb5f8e0f9c0 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.190367 Oct 12 04:19:19.327229 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 225/461] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:19 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:19.328469 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d420cebe-64a3-4444-87c1-32903743750e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:19.332131 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d420cebe-64a3-4444-87c1-32903743750e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:19.333003 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d420cebe-64a3-4444-87c1-32903743750e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:19.333512 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d420cebe-64a3-4444-87c1-32903743750e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:19.539372 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-d420cebe-64a3-4444-87c1-32903743750e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:19.550518 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-d420cebe-64a3-4444-87c1-32903743750e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:19.552362 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-d420cebe-64a3-4444-87c1-32903743750e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:19.553749 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-d420cebe-64a3-4444-87c1-32903743750e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1738 microversion: 2.20 time: 0.246270 Oct 12 04:19:19.554510 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 237/462] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:19 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1738 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:19:19.649625 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-2a26b6cc-ce0c-4baa-9bef-798d518492c4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:19.653859 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-2a26b6cc-ce0c-4baa-9bef-798d518492c4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:19.671164 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2a26b6cc-ce0c-4baa-9bef-798d518492c4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:19.671860 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2a26b6cc-ce0c-4baa-9bef-798d518492c4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:19.672831 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2a26b6cc-ce0c-4baa-9bef-798d518492c4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:19.673324 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2a26b6cc-ce0c-4baa-9bef-798d518492c4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:19.944283 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-2a26b6cc-ce0c-4baa-9bef-798d518492c4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:19.958530 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-2a26b6cc-ce0c-4baa-9bef-798d518492c4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1697 microversion: 2.1 time: 0.315067 Oct 12 04:19:19.959683 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 226/463] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:19 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1697 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:19.978257 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-f9bb3107-fb1c-4a09-92bb-f66e9835402c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:19:19.999099 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f9bb3107-fb1c-4a09-92bb-f66e9835402c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:20.000160 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f9bb3107-fb1c-4a09-92bb-f66e9835402c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:20.061609 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-f9bb3107-fb1c-4a09-92bb-f66e9835402c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Going to try to start instance {{(pid=108897) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 12 04:19:20.311089 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-f9bb3107-fb1c-4a09-92bb-f66e9835402c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 202 len: 0 microversion: 2.1 time: 0.332237 Oct 12 04:19:20.313580 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 238/464] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:19:19 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:19:20.321542 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-b463167c-a56b-4fbf-a961-aa34c2bebe02 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:20.323429 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-b463167c-a56b-4fbf-a961-aa34c2bebe02 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:20.343090 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b463167c-a56b-4fbf-a961-aa34c2bebe02 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:20.343539 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b463167c-a56b-4fbf-a961-aa34c2bebe02 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:20.344406 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b463167c-a56b-4fbf-a961-aa34c2bebe02 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:20.344912 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b463167c-a56b-4fbf-a961-aa34c2bebe02 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:20.348823 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-2563df9b-411c-4167-8a9e-9f24106dc7c2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:20.349627 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-2563df9b-411c-4167-8a9e-9f24106dc7c2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:20.368929 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2563df9b-411c-4167-8a9e-9f24106dc7c2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:20.369623 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2563df9b-411c-4167-8a9e-9f24106dc7c2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:20.371505 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2563df9b-411c-4167-8a9e-9f24106dc7c2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:20.372132 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2563df9b-411c-4167-8a9e-9f24106dc7c2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:20.595062 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-b463167c-a56b-4fbf-a961-aa34c2bebe02 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:20.615698 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-b463167c-a56b-4fbf-a961-aa34c2bebe02 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1706 microversion: 2.1 time: 0.298493 Oct 12 04:19:20.618495 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 227/465] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:20 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1706 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:20.633149 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-13054dbd-843a-42b7-83a3-200538fc71a6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:20.634237 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-13054dbd-843a-42b7-83a3-200538fc71a6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:20.652636 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-13054dbd-843a-42b7-83a3-200538fc71a6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:20.659084 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-13054dbd-843a-42b7-83a3-200538fc71a6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:20.659084 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-13054dbd-843a-42b7-83a3-200538fc71a6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:20.659084 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-13054dbd-843a-42b7-83a3-200538fc71a6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:20.819941 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-2563df9b-411c-4167-8a9e-9f24106dc7c2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:20.829059 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-2563df9b-411c-4167-8a9e-9f24106dc7c2 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.488154 Oct 12 04:19:20.834457 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 239/466] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:20 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:20.942724 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-13054dbd-843a-42b7-83a3-200538fc71a6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:20.952274 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-13054dbd-843a-42b7-83a3-200538fc71a6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:20.962608 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-13054dbd-843a-42b7-83a3-200538fc71a6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:20.964682 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-13054dbd-843a-42b7-83a3-200538fc71a6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1738 microversion: 2.20 time: 0.343524 Oct 12 04:19:20.979823 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 228/467] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:20 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1738 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:21.633439 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-09842c20-5570-4450-8968-cc17b9be0e3e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:21.634347 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-09842c20-5570-4450-8968-cc17b9be0e3e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:21.649810 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-09842c20-5570-4450-8968-cc17b9be0e3e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:21.650588 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-09842c20-5570-4450-8968-cc17b9be0e3e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:21.651194 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-09842c20-5570-4450-8968-cc17b9be0e3e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:21.651625 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-09842c20-5570-4450-8968-cc17b9be0e3e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:21.848752 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-bff7677d-f7ef-4426-8524-51798720cc14 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:21.849605 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-bff7677d-f7ef-4426-8524-51798720cc14 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:21.860770 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-bff7677d-f7ef-4426-8524-51798720cc14 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:21.872678 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-bff7677d-f7ef-4426-8524-51798720cc14 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:21.874392 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-bff7677d-f7ef-4426-8524-51798720cc14 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:21.874949 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-bff7677d-f7ef-4426-8524-51798720cc14 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:21.928181 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-09842c20-5570-4450-8968-cc17b9be0e3e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:21.969800 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-09842c20-5570-4450-8968-cc17b9be0e3e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1706 microversion: 2.1 time: 0.333762 Oct 12 04:19:21.969800 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 240/468] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:21 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1706 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:21.991932 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-111c2f00-07f9-409b-ba43-c986ea93478e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:21.992811 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-111c2f00-07f9-409b-ba43-c986ea93478e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:22.003913 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-111c2f00-07f9-409b-ba43-c986ea93478e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:22.004053 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-111c2f00-07f9-409b-ba43-c986ea93478e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:22.005493 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-111c2f00-07f9-409b-ba43-c986ea93478e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:22.006006 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-111c2f00-07f9-409b-ba43-c986ea93478e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:22.186636 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-bff7677d-f7ef-4426-8524-51798720cc14 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:22.196552 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-bff7677d-f7ef-4426-8524-51798720cc14 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.352633 Oct 12 04:19:22.202852 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 229/469] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:21 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:22.272752 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-111c2f00-07f9-409b-ba43-c986ea93478e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:22.283542 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-111c2f00-07f9-409b-ba43-c986ea93478e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:22.287646 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-111c2f00-07f9-409b-ba43-c986ea93478e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:22.287646 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-111c2f00-07f9-409b-ba43-c986ea93478e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1738 microversion: 2.20 time: 0.299735 Oct 12 04:19:22.287646 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 241/470] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:21 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1738 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:19:22.985509 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-abda794c-696b-411c-bf8d-5ec50b731ae4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:22.986787 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-abda794c-696b-411c-bf8d-5ec50b731ae4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:22.992541 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-abda794c-696b-411c-bf8d-5ec50b731ae4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:22.993003 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-abda794c-696b-411c-bf8d-5ec50b731ae4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:22.993739 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-abda794c-696b-411c-bf8d-5ec50b731ae4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:22.994167 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-abda794c-696b-411c-bf8d-5ec50b731ae4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:23.112211 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-abda794c-696b-411c-bf8d-5ec50b731ae4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:23.119812 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-abda794c-696b-411c-bf8d-5ec50b731ae4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1706 microversion: 2.1 time: 0.138244 Oct 12 04:19:23.120365 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 230/471] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:22 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1706 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:23.220208 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-c3ea7b37-a7bc-4d86-8c25-ad004b339d83 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:23.221432 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-c3ea7b37-a7bc-4d86-8c25-ad004b339d83 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:23.227207 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c3ea7b37-a7bc-4d86-8c25-ad004b339d83 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:23.227652 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c3ea7b37-a7bc-4d86-8c25-ad004b339d83 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:23.228403 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c3ea7b37-a7bc-4d86-8c25-ad004b339d83 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:23.228831 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c3ea7b37-a7bc-4d86-8c25-ad004b339d83 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:23.307642 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-82f8b594-6478-4590-8efc-3b3fb006269e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:23.308254 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-82f8b594-6478-4590-8efc-3b3fb006269e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:23.317573 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-82f8b594-6478-4590-8efc-3b3fb006269e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:23.318012 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-82f8b594-6478-4590-8efc-3b3fb006269e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:23.318807 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-82f8b594-6478-4590-8efc-3b3fb006269e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:23.319236 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-82f8b594-6478-4590-8efc-3b3fb006269e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:23.396137 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-c3ea7b37-a7bc-4d86-8c25-ad004b339d83 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:23.407545 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-c3ea7b37-a7bc-4d86-8c25-ad004b339d83 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.188647 Oct 12 04:19:23.414467 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 242/472] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:23 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:23.469877 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-82f8b594-6478-4590-8efc-3b3fb006269e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:23.478937 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-82f8b594-6478-4590-8efc-3b3fb006269e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:23.480442 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-82f8b594-6478-4590-8efc-3b3fb006269e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:23.481705 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-82f8b594-6478-4590-8efc-3b3fb006269e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1738 microversion: 2.20 time: 0.177859 Oct 12 04:19:23.482255 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 231/473] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:23 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:19:24.143779 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-284e6573-73d3-400e-aa33-3dbf3384035e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:24.144738 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-284e6573-73d3-400e-aa33-3dbf3384035e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:24.171055 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-284e6573-73d3-400e-aa33-3dbf3384035e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:24.178442 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-284e6573-73d3-400e-aa33-3dbf3384035e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:24.182749 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-284e6573-73d3-400e-aa33-3dbf3384035e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:24.182749 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-284e6573-73d3-400e-aa33-3dbf3384035e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:24.412535 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-ccb89d6c-cf81-4157-a196-9dae2a62ab11 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:24.413087 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-ccb89d6c-cf81-4157-a196-9dae2a62ab11 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:24.420695 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ccb89d6c-cf81-4157-a196-9dae2a62ab11 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:24.421240 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ccb89d6c-cf81-4157-a196-9dae2a62ab11 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:24.422347 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ccb89d6c-cf81-4157-a196-9dae2a62ab11 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:24.423335 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ccb89d6c-cf81-4157-a196-9dae2a62ab11 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:24.448547 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-284e6573-73d3-400e-aa33-3dbf3384035e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:24.460805 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-284e6573-73d3-400e-aa33-3dbf3384035e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1710 microversion: 2.1 time: 0.320710 Oct 12 04:19:24.461625 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 243/474] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:24 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1710 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:24.467102 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-fccc3338-2e38-4682-b3d6-79c7d1d10e24 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:24.468175 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-fccc3338-2e38-4682-b3d6-79c7d1d10e24 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:24.476558 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fccc3338-2e38-4682-b3d6-79c7d1d10e24 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:24.477365 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fccc3338-2e38-4682-b3d6-79c7d1d10e24 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:24.478527 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fccc3338-2e38-4682-b3d6-79c7d1d10e24 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:24.479204 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fccc3338-2e38-4682-b3d6-79c7d1d10e24 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:24.531693 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.objects.instance [None req-ccb89d6c-cf81-4157-a196-9dae2a62ab11 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lazy-loading 'services' on Instance uuid d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 {{(pid=108898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:19:24.644842 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-fccc3338-2e38-4682-b3d6-79c7d1d10e24 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:24.653739 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-fccc3338-2e38-4682-b3d6-79c7d1d10e24 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.190914 Oct 12 04:19:24.654560 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 244/475] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:24 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:24.660098 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-192e7efc-09f6-49b9-853c-8cfdecddd8f5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:24.660689 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-192e7efc-09f6-49b9-853c-8cfdecddd8f5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:24.666758 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-192e7efc-09f6-49b9-853c-8cfdecddd8f5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:24.667147 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-192e7efc-09f6-49b9-853c-8cfdecddd8f5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:24.667908 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-192e7efc-09f6-49b9-853c-8cfdecddd8f5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:24.668330 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-192e7efc-09f6-49b9-853c-8cfdecddd8f5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:24.765694 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-ccb89d6c-cf81-4157-a196-9dae2a62ab11 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "DELETE /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1/os-volume_attachments/c2a19ecd-192e-4c3a-bba4-f9ce7902e897" status: 202 len: 0 microversion: 2.1 time: 0.358486 Oct 12 04:19:24.767397 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 232/476] 10.222.0.21 () {58 vars in 1415 bytes} [Tue Oct 12 04:19:24 2021] DELETE /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1/os-volume_attachments/c2a19ecd-192e-4c3a-bba4-f9ce7902e897 => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 04:19:24.793565 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-adfeaa31-a1a1-44a2-a9fd-d7a2e80a4e90 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:24.796183 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-adfeaa31-a1a1-44a2-a9fd-d7a2e80a4e90 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:24.810468 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-adfeaa31-a1a1-44a2-a9fd-d7a2e80a4e90 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:24.810964 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-adfeaa31-a1a1-44a2-a9fd-d7a2e80a4e90 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:24.811781 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-adfeaa31-a1a1-44a2-a9fd-d7a2e80a4e90 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:24.812212 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-adfeaa31-a1a1-44a2-a9fd-d7a2e80a4e90 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:24.825024 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-192e7efc-09f6-49b9-853c-8cfdecddd8f5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:24.833941 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-192e7efc-09f6-49b9-853c-8cfdecddd8f5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:24.835524 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-192e7efc-09f6-49b9-853c-8cfdecddd8f5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:24.836760 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-192e7efc-09f6-49b9-853c-8cfdecddd8f5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1738 microversion: 2.20 time: 0.180795 Oct 12 04:19:24.837284 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 245/477] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:24 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:24.843244 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-adfeaa31-a1a1-44a2-a9fd-d7a2e80a4e90 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071050 Oct 12 04:19:24.843941 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 233/478] 10.222.0.21 () {58 vars in 1301 bytes} [Tue Oct 12 04:19:24 2021] GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:19:25.670701 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-bd334a57-6704-491f-babf-ed7f67ca64df tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:25.671473 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-bd334a57-6704-491f-babf-ed7f67ca64df tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:25.678119 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bd334a57-6704-491f-babf-ed7f67ca64df tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:25.678508 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bd334a57-6704-491f-babf-ed7f67ca64df tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:25.679354 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bd334a57-6704-491f-babf-ed7f67ca64df tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:25.679789 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bd334a57-6704-491f-babf-ed7f67ca64df tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:25.808744 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-bd334a57-6704-491f-babf-ed7f67ca64df tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:25.817421 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-bd334a57-6704-491f-babf-ed7f67ca64df tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.150517 Oct 12 04:19:25.818577 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 246/479] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:25 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:19:25.855689 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-6331af22-8601-4dd5-97c8-8877002d58a2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:25.856224 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-17d1b0b4-faa4-4722-a041-0685850f88c1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:25.856342 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-6331af22-8601-4dd5-97c8-8877002d58a2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:25.857127 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-17d1b0b4-faa4-4722-a041-0685850f88c1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:25.863724 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6331af22-8601-4dd5-97c8-8877002d58a2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:25.864240 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6331af22-8601-4dd5-97c8-8877002d58a2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:25.864656 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-17d1b0b4-faa4-4722-a041-0685850f88c1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:25.865392 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-17d1b0b4-faa4-4722-a041-0685850f88c1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:25.866539 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-17d1b0b4-faa4-4722-a041-0685850f88c1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:25.867502 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-17d1b0b4-faa4-4722-a041-0685850f88c1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:25.868588 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6331af22-8601-4dd5-97c8-8877002d58a2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:25.869464 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6331af22-8601-4dd5-97c8-8877002d58a2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:25.901466 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-17d1b0b4-faa4-4722-a041-0685850f88c1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049398 Oct 12 04:19:25.902021 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 247/480] 10.222.0.21 () {58 vars in 1301 bytes} [Tue Oct 12 04:19:25 2021] GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:19:26.003338 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-6331af22-8601-4dd5-97c8-8877002d58a2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:26.011480 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-6331af22-8601-4dd5-97c8-8877002d58a2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:26.013196 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-6331af22-8601-4dd5-97c8-8877002d58a2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:26.014071 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-6331af22-8601-4dd5-97c8-8877002d58a2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1738 microversion: 2.20 time: 0.162114 Oct 12 04:19:26.014628 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 234/481] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:25 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:19:26.841120 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-3342c215-129e-4562-afa3-cbd74c4d0aab tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:26.841836 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-3342c215-129e-4562-afa3-cbd74c4d0aab tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:26.847646 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3342c215-129e-4562-afa3-cbd74c4d0aab tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:26.848139 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3342c215-129e-4562-afa3-cbd74c4d0aab tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:26.848892 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3342c215-129e-4562-afa3-cbd74c4d0aab tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:26.849317 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3342c215-129e-4562-afa3-cbd74c4d0aab tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:26.912172 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-9730f9b2-f43c-411c-8ee1-e5140394620e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:26.917273 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-9730f9b2-f43c-411c-8ee1-e5140394620e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:26.919165 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9730f9b2-f43c-411c-8ee1-e5140394620e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:26.919620 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9730f9b2-f43c-411c-8ee1-e5140394620e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:26.920398 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9730f9b2-f43c-411c-8ee1-e5140394620e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:26.920832 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9730f9b2-f43c-411c-8ee1-e5140394620e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:26.951738 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-9730f9b2-f43c-411c-8ee1-e5140394620e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043245 Oct 12 04:19:26.952485 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 235/482] 10.222.0.21 () {58 vars in 1301 bytes} [Tue Oct 12 04:19:26 2021] GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 04:19:26.978280 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-3342c215-129e-4562-afa3-cbd74c4d0aab tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:26.987309 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-3342c215-129e-4562-afa3-cbd74c4d0aab tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.149512 Oct 12 04:19:26.987878 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 248/483] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:26 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:27.031560 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-4717a1f2-791a-4db8-bc97-45b647cdc1d5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:27.032240 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-4717a1f2-791a-4db8-bc97-45b647cdc1d5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:27.037937 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4717a1f2-791a-4db8-bc97-45b647cdc1d5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:27.038370 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4717a1f2-791a-4db8-bc97-45b647cdc1d5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:27.039161 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4717a1f2-791a-4db8-bc97-45b647cdc1d5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:27.039593 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4717a1f2-791a-4db8-bc97-45b647cdc1d5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:27.166209 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-4717a1f2-791a-4db8-bc97-45b647cdc1d5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:27.173800 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-4717a1f2-791a-4db8-bc97-45b647cdc1d5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:27.175817 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-4717a1f2-791a-4db8-bc97-45b647cdc1d5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:27.182104 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-4717a1f2-791a-4db8-bc97-45b647cdc1d5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1720 microversion: 2.20 time: 0.149095 Oct 12 04:19:27.182104 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 236/484] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:27 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:19:28.005222 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-d97eedeb-4dfb-4e73-9219-01a95da82f14 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:28.005835 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-d97eedeb-4dfb-4e73-9219-01a95da82f14 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:28.012261 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d97eedeb-4dfb-4e73-9219-01a95da82f14 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:28.012710 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d97eedeb-4dfb-4e73-9219-01a95da82f14 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:28.013498 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d97eedeb-4dfb-4e73-9219-01a95da82f14 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:28.013939 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d97eedeb-4dfb-4e73-9219-01a95da82f14 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:28.140519 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-d97eedeb-4dfb-4e73-9219-01a95da82f14 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:28.148894 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-d97eedeb-4dfb-4e73-9219-01a95da82f14 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.147898 Oct 12 04:19:28.149474 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 249/485] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:27 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:28.196438 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d334f4cd-fd25-4479-b201-54adaadfeaea tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:28.197032 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-d334f4cd-fd25-4479-b201-54adaadfeaea tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:28.202880 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d334f4cd-fd25-4479-b201-54adaadfeaea tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:28.207403 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d334f4cd-fd25-4479-b201-54adaadfeaea tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:28.207403 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d334f4cd-fd25-4479-b201-54adaadfeaea tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:28.207403 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d334f4cd-fd25-4479-b201-54adaadfeaea tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:28.328304 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-8c31a1b9-5813-407d-b2ed-eab92cdfce2d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:28.328787 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-8c31a1b9-5813-407d-b2ed-eab92cdfce2d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:28.329068 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-d334f4cd-fd25-4479-b201-54adaadfeaea tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:28.335732 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8c31a1b9-5813-407d-b2ed-eab92cdfce2d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:28.336173 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8c31a1b9-5813-407d-b2ed-eab92cdfce2d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:28.336933 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8c31a1b9-5813-407d-b2ed-eab92cdfce2d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:28.337360 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8c31a1b9-5813-407d-b2ed-eab92cdfce2d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:28.338989 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-d334f4cd-fd25-4479-b201-54adaadfeaea tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:28.340561 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-d334f4cd-fd25-4479-b201-54adaadfeaea tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:28.341740 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-d334f4cd-fd25-4479-b201-54adaadfeaea tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1720 microversion: 2.20 time: 0.149040 Oct 12 04:19:28.342289 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 237/486] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:28 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:28.362397 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-8c31a1b9-5813-407d-b2ed-eab92cdfce2d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Going to try to terminate instance {{(pid=108897) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 04:19:28.688876 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-8c31a1b9-5813-407d-b2ed-eab92cdfce2d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "DELETE /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1" status: 204 len: 0 microversion: 2.1 time: 0.363912 Oct 12 04:19:28.689497 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 250/487] 10.222.0.21 () {58 vars in 1238 bytes} [Tue Oct 12 04:19:28 2021] DELETE /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 04:19:28.697847 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-a3be1580-62a3-4e53-8732-958b228feb70 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:28.698628 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-a3be1580-62a3-4e53-8732-958b228feb70 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:28.704672 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a3be1580-62a3-4e53-8732-958b228feb70 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:28.705193 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a3be1580-62a3-4e53-8732-958b228feb70 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:28.706035 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a3be1580-62a3-4e53-8732-958b228feb70 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:28.706547 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a3be1580-62a3-4e53-8732-958b228feb70 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:28.872297 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-a3be1580-62a3-4e53-8732-958b228feb70 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:28.879436 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-a3be1580-62a3-4e53-8732-958b228feb70 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1" status: 200 len: 1513 microversion: 2.1 time: 0.185205 Oct 12 04:19:28.879984 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 238/488] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:28 2021] GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:29.156999 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-75ad5f1f-d502-4565-af1e-3471c861366c req-57225133-bf89-4c76-9e62-45b71826407b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29fcfae4-9349-4167-9403-9a4a20f346bd", "name": "network-vif-unplugged", "status": "completed", "tag": "c5a9a497-7d69-4ed5-85cb-fa9a1cc1b4bf"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:19:29.159304 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:19:29.159304 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:19:29.166937 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-3be79699-ddda-463d-9c15-09a9ce6a4438 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:29.167719 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-75ad5f1f-d502-4565-af1e-3471c861366c req-57225133-bf89-4c76-9e62-45b71826407b service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:29.167880 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-3be79699-ddda-463d-9c15-09a9ce6a4438 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:29.168233 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-75ad5f1f-d502-4565-af1e-3471c861366c req-57225133-bf89-4c76-9e62-45b71826407b service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:29.173710 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3be79699-ddda-463d-9c15-09a9ce6a4438 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:29.174161 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3be79699-ddda-463d-9c15-09a9ce6a4438 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:29.174963 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3be79699-ddda-463d-9c15-09a9ce6a4438 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:29.175541 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3be79699-ddda-463d-9c15-09a9ce6a4438 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:29.180884 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-75ad5f1f-d502-4565-af1e-3471c861366c req-57225133-bf89-4c76-9e62-45b71826407b service nova] Creating event network-vif-unplugged:c5a9a497-7d69-4ed5-85cb-fa9a1cc1b4bf for instance 29fcfae4-9349-4167-9403-9a4a20f346bd on hv-cinder-81306 Oct 12 04:19:29.185973 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-75ad5f1f-d502-4565-af1e-3471c861366c req-57225133-bf89-4c76-9e62-45b71826407b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033182 Oct 12 04:19:29.186577 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 251/489] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:19:29 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:19:29.302397 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-3be79699-ddda-463d-9c15-09a9ce6a4438 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:29.310497 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-3be79699-ddda-463d-9c15-09a9ce6a4438 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.148504 Oct 12 04:19:29.312017 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 239/490] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:29 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:19:29.361048 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-aa2f4735-41c7-4cae-8c88-1907236fe8ec tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:29.361732 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-aa2f4735-41c7-4cae-8c88-1907236fe8ec tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:29.368377 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-aa2f4735-41c7-4cae-8c88-1907236fe8ec tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:29.375130 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-aa2f4735-41c7-4cae-8c88-1907236fe8ec tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:29.375130 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-aa2f4735-41c7-4cae-8c88-1907236fe8ec tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:29.375130 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-aa2f4735-41c7-4cae-8c88-1907236fe8ec tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:29.497418 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-aa2f4735-41c7-4cae-8c88-1907236fe8ec tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:29.505705 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-aa2f4735-41c7-4cae-8c88-1907236fe8ec tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:29.507355 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-aa2f4735-41c7-4cae-8c88-1907236fe8ec tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:29.508639 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-aa2f4735-41c7-4cae-8c88-1907236fe8ec tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1720 microversion: 2.20 time: 0.151819 Oct 12 04:19:29.509306 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 252/491] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:29 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:29.896248 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-417527b9-9242-4910-aede-ada5a4268ce7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:29.896792 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-417527b9-9242-4910-aede-ada5a4268ce7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:29.902536 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-417527b9-9242-4910-aede-ada5a4268ce7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:29.902999 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-417527b9-9242-4910-aede-ada5a4268ce7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:29.903765 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-417527b9-9242-4910-aede-ada5a4268ce7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:29.904188 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-417527b9-9242-4910-aede-ada5a4268ce7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:30.053390 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-417527b9-9242-4910-aede-ada5a4268ce7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:30.060889 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-417527b9-9242-4910-aede-ada5a4268ce7 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1" status: 200 len: 1513 microversion: 2.1 time: 0.168354 Oct 12 04:19:30.061444 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 240/492] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:29 2021] GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:19:30.327288 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-b1073bb9-bd19-4ed0-ae37-8ba7a3bcc0fc tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:30.328105 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-b1073bb9-bd19-4ed0-ae37-8ba7a3bcc0fc tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:30.334184 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b1073bb9-bd19-4ed0-ae37-8ba7a3bcc0fc tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:30.334641 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b1073bb9-bd19-4ed0-ae37-8ba7a3bcc0fc tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:30.335462 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b1073bb9-bd19-4ed0-ae37-8ba7a3bcc0fc tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:30.335990 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b1073bb9-bd19-4ed0-ae37-8ba7a3bcc0fc tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:30.459236 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-b1073bb9-bd19-4ed0-ae37-8ba7a3bcc0fc tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:30.466909 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-b1073bb9-bd19-4ed0-ae37-8ba7a3bcc0fc tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.143293 Oct 12 04:19:30.467468 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 253/493] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:30 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:30.528580 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-c7a11a19-c75b-486b-a5fd-1ac8d60427da tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:30.529189 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-c7a11a19-c75b-486b-a5fd-1ac8d60427da tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:30.535025 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c7a11a19-c75b-486b-a5fd-1ac8d60427da tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:30.535475 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c7a11a19-c75b-486b-a5fd-1ac8d60427da tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:30.536738 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c7a11a19-c75b-486b-a5fd-1ac8d60427da tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:30.537171 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c7a11a19-c75b-486b-a5fd-1ac8d60427da tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:30.673408 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c7a11a19-c75b-486b-a5fd-1ac8d60427da tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:30.676328 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c7a11a19-c75b-486b-a5fd-1ac8d60427da tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:30.678138 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c7a11a19-c75b-486b-a5fd-1ac8d60427da tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:30.679593 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-c7a11a19-c75b-486b-a5fd-1ac8d60427da tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1663 microversion: 2.20 time: 0.155143 Oct 12 04:19:30.682803 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 241/494] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:30 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:30.697725 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-e31e3cfc-ad1a-48f3-9655-17e78c95bf40 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae993f5f-7f78-4035-842f-49c51598ed9b"}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:19:30.698951 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-e31e3cfc-ad1a-48f3-9655-17e78c95bf40 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:30.707669 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e31e3cfc-ad1a-48f3-9655-17e78c95bf40 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:30.708657 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e31e3cfc-ad1a-48f3-9655-17e78c95bf40 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:30.709475 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e31e3cfc-ad1a-48f3-9655-17e78c95bf40 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:30.709984 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e31e3cfc-ad1a-48f3-9655-17e78c95bf40 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:31.078400 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-7033061d-121d-4fbf-9b51-752dcfe1a5a4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:31.080502 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-7033061d-121d-4fbf-9b51-752dcfe1a5a4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:31.086383 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7033061d-121d-4fbf-9b51-752dcfe1a5a4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:31.087113 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7033061d-121d-4fbf-9b51-752dcfe1a5a4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:31.088101 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7033061d-121d-4fbf-9b51-752dcfe1a5a4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:31.088714 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7033061d-121d-4fbf-9b51-752dcfe1a5a4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:31.227720 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-7033061d-121d-4fbf-9b51-752dcfe1a5a4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:31.236079 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-7033061d-121d-4fbf-9b51-752dcfe1a5a4 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1" status: 200 len: 1513 microversion: 2.1 time: 0.162698 Oct 12 04:19:31.236647 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 242/495] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:31 2021] GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:31.490329 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-ead9fe2d-e76d-4856-b344-bdaa5ddb7554 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:31.490960 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-ead9fe2d-e76d-4856-b344-bdaa5ddb7554 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:31.496678 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ead9fe2d-e76d-4856-b344-bdaa5ddb7554 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:31.497122 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ead9fe2d-e76d-4856-b344-bdaa5ddb7554 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:31.497885 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ead9fe2d-e76d-4856-b344-bdaa5ddb7554 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:31.498315 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ead9fe2d-e76d-4856-b344-bdaa5ddb7554 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:31.624687 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-ead9fe2d-e76d-4856-b344-bdaa5ddb7554 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:31.633872 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-ead9fe2d-e76d-4856-b344-bdaa5ddb7554 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.148540 Oct 12 04:19:31.634682 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 243/496] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:31 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:19:31.747666 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-e31e3cfc-ad1a-48f3-9655-17e78c95bf40 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.053786 Oct 12 04:19:31.748722 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 254/497] 10.222.0.21 () {62 vars in 1363 bytes} [Tue Oct 12 04:19:30 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/os-volume_attachments => generated 188 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:19:31.813917 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-a0a1b801-db0c-496e-b250-849b5913844e req-3ff8fe7b-94cf-45b5-8893-273e5aa0e4ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d32dbe5f-c1a2-49d5-af68-7b63840b6fe1", "name": "network-vif-deleted", "tag": "17b2b723-b4bf-43d9-a54c-66b78ab77724"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:19:31.826975 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:19:31.826975 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:19:31.834792 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-a0a1b801-db0c-496e-b250-849b5913844e req-3ff8fe7b-94cf-45b5-8893-273e5aa0e4ca service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:31.835515 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-a0a1b801-db0c-496e-b250-849b5913844e req-3ff8fe7b-94cf-45b5-8893-273e5aa0e4ca service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:31.846964 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-a0a1b801-db0c-496e-b250-849b5913844e req-3ff8fe7b-94cf-45b5-8893-273e5aa0e4ca service nova] Creating event network-vif-deleted:17b2b723-b4bf-43d9-a54c-66b78ab77724 for instance d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 on hv-cinder-81306 Oct 12 04:19:31.852528 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-a0a1b801-db0c-496e-b250-849b5913844e req-3ff8fe7b-94cf-45b5-8893-273e5aa0e4ca service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042139 Oct 12 04:19:31.853122 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 244/498] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:19:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:19:31.887346 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-87007980-5e90-489d-bce4-998db5bcb424 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:19:31.887910 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-87007980-5e90-489d-bce4-998db5bcb424 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:31.896849 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-87007980-5e90-489d-bce4-998db5bcb424 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:31.897293 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-87007980-5e90-489d-bce4-998db5bcb424 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:31.898059 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-87007980-5e90-489d-bce4-998db5bcb424 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:31.898491 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-87007980-5e90-489d-bce4-998db5bcb424 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:32.166984 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-87007980-5e90-489d-bce4-998db5bcb424 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action" status: 202 len: 0 microversion: 2.20 time: 0.283137 Oct 12 04:19:32.177925 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-c3e282dd-99bc-4c28-8af8-c29ab84538fc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:32.179038 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-c3e282dd-99bc-4c28-8af8-c29ab84538fc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:32.182010 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 255/499] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:19:31 2021] POST /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 04:19:32.186713 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c3e282dd-99bc-4c28-8af8-c29ab84538fc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:32.187227 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c3e282dd-99bc-4c28-8af8-c29ab84538fc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:32.188162 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c3e282dd-99bc-4c28-8af8-c29ab84538fc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:32.189134 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c3e282dd-99bc-4c28-8af8-c29ab84538fc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:32.253167 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-6f980f8e-c345-495d-a658-a4e1d8e43cf0 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:32.253778 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-6f980f8e-c345-495d-a658-a4e1d8e43cf0 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:32.260268 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6f980f8e-c345-495d-a658-a4e1d8e43cf0 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:32.260720 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6f980f8e-c345-495d-a658-a4e1d8e43cf0 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:32.261483 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6f980f8e-c345-495d-a658-a4e1d8e43cf0 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:32.261925 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6f980f8e-c345-495d-a658-a4e1d8e43cf0 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:32.304824 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6f980f8e-c345-495d-a658-a4e1d8e43cf0 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:32.305117 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6f980f8e-c345-495d-a658-a4e1d8e43cf0 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:32.305581 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.objects.instance [None req-6f980f8e-c345-495d-a658-a4e1d8e43cf0 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lazy-loading 'fault' on Instance uuid d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 {{(pid=108897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:19:32.314033 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c3e282dd-99bc-4c28-8af8-c29ab84538fc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:32.323247 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c3e282dd-99bc-4c28-8af8-c29ab84538fc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:32.324737 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c3e282dd-99bc-4c28-8af8-c29ab84538fc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:32.337785 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-c3e282dd-99bc-4c28-8af8-c29ab84538fc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1749 microversion: 2.20 time: 0.152592 Oct 12 04:19:32.337785 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 245/500] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:32 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:32.349007 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-6f980f8e-c345-495d-a658-a4e1d8e43cf0 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:32.356395 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-6f980f8e-c345-495d-a658-a4e1d8e43cf0 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1" status: 200 len: 1307 microversion: 2.1 time: 0.106994 Oct 12 04:19:32.358639 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 256/501] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:32 2021] GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 => generated 1307 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:19:32.650890 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-e8b9f0fc-ce94-4096-9627-5acfdf7c08cb tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:32.651501 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-e8b9f0fc-ce94-4096-9627-5acfdf7c08cb tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:32.657165 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e8b9f0fc-ce94-4096-9627-5acfdf7c08cb tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:32.657607 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e8b9f0fc-ce94-4096-9627-5acfdf7c08cb tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:32.658361 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e8b9f0fc-ce94-4096-9627-5acfdf7c08cb tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:32.658877 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e8b9f0fc-ce94-4096-9627-5acfdf7c08cb tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:32.790930 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-e8b9f0fc-ce94-4096-9627-5acfdf7c08cb tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:32.799258 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-e8b9f0fc-ce94-4096-9627-5acfdf7c08cb tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.152073 Oct 12 04:19:32.799812 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 246/502] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:32 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:19:33.347636 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-09cd50ed-e205-432f-a87f-f70ac2eae3fa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:33.352392 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-09cd50ed-e205-432f-a87f-f70ac2eae3fa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:33.354271 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-09cd50ed-e205-432f-a87f-f70ac2eae3fa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:33.354735 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-09cd50ed-e205-432f-a87f-f70ac2eae3fa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:33.355491 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-09cd50ed-e205-432f-a87f-f70ac2eae3fa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:33.356019 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-09cd50ed-e205-432f-a87f-f70ac2eae3fa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:33.373343 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-4b3eafab-c2db-47e1-819d-f339bd8b3d5d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:33.374095 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-4b3eafab-c2db-47e1-819d-f339bd8b3d5d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: d32dbe5f-c1a2-49d5-af68-7b63840b6fe1] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:33.380376 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4b3eafab-c2db-47e1-819d-f339bd8b3d5d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:33.381066 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4b3eafab-c2db-47e1-819d-f339bd8b3d5d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:33.381834 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4b3eafab-c2db-47e1-819d-f339bd8b3d5d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:33.382411 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4b3eafab-c2db-47e1-819d-f339bd8b3d5d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:33.397852 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.wsgi [None req-4b3eafab-c2db-47e1-819d-f339bd8b3d5d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] HTTP exception thrown: Instance d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 could not be found. Oct 12 04:19:33.398433 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-4b3eafab-c2db-47e1-819d-f339bd8b3d5d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Returning 404 to user: Instance d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 could not be found. {{(pid=108898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:19:33.399283 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-4b3eafab-c2db-47e1-819d-f339bd8b3d5d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1" status: 404 len: 111 microversion: 2.1 time: 0.029677 Oct 12 04:19:33.400164 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 247/503] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:33 2021] GET /compute/v2.1/servers/d32dbe5f-c1a2-49d5-af68-7b63840b6fe1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 04:19:33.483592 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-09cd50ed-e205-432f-a87f-f70ac2eae3fa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:33.491781 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-09cd50ed-e205-432f-a87f-f70ac2eae3fa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:33.493299 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-09cd50ed-e205-432f-a87f-f70ac2eae3fa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:33.494420 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-09cd50ed-e205-432f-a87f-f70ac2eae3fa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1749 microversion: 2.20 time: 0.150539 Oct 12 04:19:33.495035 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 257/504] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:33 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1749 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:33.816892 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-f0982eb3-1361-43d6-bac6-c80b40ba6f6b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:33.818130 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-f0982eb3-1361-43d6-bac6-c80b40ba6f6b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:33.823816 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f0982eb3-1361-43d6-bac6-c80b40ba6f6b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:33.824256 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f0982eb3-1361-43d6-bac6-c80b40ba6f6b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:33.825009 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f0982eb3-1361-43d6-bac6-c80b40ba6f6b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:33.825441 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f0982eb3-1361-43d6-bac6-c80b40ba6f6b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:33.949564 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-f0982eb3-1361-43d6-bac6-c80b40ba6f6b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:33.958201 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-f0982eb3-1361-43d6-bac6-c80b40ba6f6b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.144921 Oct 12 04:19:33.958794 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 248/505] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:33 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:34.513785 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-471e7908-7264-4791-bf33-11b5e7c48828 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:34.514321 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-471e7908-7264-4791-bf33-11b5e7c48828 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:34.520038 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-471e7908-7264-4791-bf33-11b5e7c48828 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:34.520997 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-471e7908-7264-4791-bf33-11b5e7c48828 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:34.521736 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-471e7908-7264-4791-bf33-11b5e7c48828 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:34.522168 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-471e7908-7264-4791-bf33-11b5e7c48828 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:34.642394 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-471e7908-7264-4791-bf33-11b5e7c48828 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:34.651061 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-471e7908-7264-4791-bf33-11b5e7c48828 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:34.652547 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-471e7908-7264-4791-bf33-11b5e7c48828 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:34.653685 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-471e7908-7264-4791-bf33-11b5e7c48828 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1751 microversion: 2.20 time: 0.143711 Oct 12 04:19:34.654234 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 258/506] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:34 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1751 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:34.705985 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d5b50566-7da0-4cd4-9de7-d0701ef08c7e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:34.706473 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-d5b50566-7da0-4cd4-9de7-d0701ef08c7e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:34.712840 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d5b50566-7da0-4cd4-9de7-d0701ef08c7e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:34.713274 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d5b50566-7da0-4cd4-9de7-d0701ef08c7e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:34.714020 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d5b50566-7da0-4cd4-9de7-d0701ef08c7e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:34.714442 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d5b50566-7da0-4cd4-9de7-d0701ef08c7e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:34.737939 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-d5b50566-7da0-4cd4-9de7-d0701ef08c7e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Going to try to terminate instance {{(pid=108898) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 04:19:34.975059 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ca947c29-5aff-49da-9a7e-cc0da2d675e4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:34.975657 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ca947c29-5aff-49da-9a7e-cc0da2d675e4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:34.982316 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ca947c29-5aff-49da-9a7e-cc0da2d675e4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:34.982976 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ca947c29-5aff-49da-9a7e-cc0da2d675e4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:34.983942 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ca947c29-5aff-49da-9a7e-cc0da2d675e4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:34.984367 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ca947c29-5aff-49da-9a7e-cc0da2d675e4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:35.072973 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-d5b50566-7da0-4cd4-9de7-d0701ef08c7e tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "DELETE /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 204 len: 0 microversion: 2.1 time: 0.370419 Oct 12 04:19:35.074112 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 249/507] 10.222.0.21 () {58 vars in 1238 bytes} [Tue Oct 12 04:19:34 2021] DELETE /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 04:19:35.088377 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-084e38e2-923a-4baf-8450-296a3676ea17 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:35.089076 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-084e38e2-923a-4baf-8450-296a3676ea17 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:35.094971 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-084e38e2-923a-4baf-8450-296a3676ea17 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:35.095421 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-084e38e2-923a-4baf-8450-296a3676ea17 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:35.096191 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-084e38e2-923a-4baf-8450-296a3676ea17 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:35.096614 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-084e38e2-923a-4baf-8450-296a3676ea17 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:35.111163 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-ca947c29-5aff-49da-9a7e-cc0da2d675e4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:35.119453 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ca947c29-5aff-49da-9a7e-cc0da2d675e4 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.148117 Oct 12 04:19:35.129414 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 259/508] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:34 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:19:35.224228 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-084e38e2-923a-4baf-8450-296a3676ea17 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:35.231589 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-084e38e2-923a-4baf-8450-296a3676ea17 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 200 len: 1514 microversion: 2.1 time: 0.153281 Oct 12 04:19:35.234622 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 250/509] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:35 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:19:35.679067 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-54d1c8bf-a3cf-437f-b50e-e389e268ddd7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:35.679673 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-54d1c8bf-a3cf-437f-b50e-e389e268ddd7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:35.685629 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-54d1c8bf-a3cf-437f-b50e-e389e268ddd7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:35.686081 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-54d1c8bf-a3cf-437f-b50e-e389e268ddd7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:35.686965 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-54d1c8bf-a3cf-437f-b50e-e389e268ddd7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:35.687318 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-54d1c8bf-a3cf-437f-b50e-e389e268ddd7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:35.807299 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-54d1c8bf-a3cf-437f-b50e-e389e268ddd7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:35.816813 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-54d1c8bf-a3cf-437f-b50e-e389e268ddd7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:35.818293 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-54d1c8bf-a3cf-437f-b50e-e389e268ddd7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:35.819453 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-54d1c8bf-a3cf-437f-b50e-e389e268ddd7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1807 microversion: 2.20 time: 0.144786 Oct 12 04:19:35.819993 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 260/510] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:35 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1807 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:36.138059 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-4e1e6329-6726-48f1-ac2f-298f43c0972b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:36.139250 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-4e1e6329-6726-48f1-ac2f-298f43c0972b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:36.145102 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4e1e6329-6726-48f1-ac2f-298f43c0972b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:36.146040 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4e1e6329-6726-48f1-ac2f-298f43c0972b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:36.146891 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4e1e6329-6726-48f1-ac2f-298f43c0972b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:36.147317 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4e1e6329-6726-48f1-ac2f-298f43c0972b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:36.249374 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-812727f5-4b48-40fa-aa72-32c35891deec tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:36.249871 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-812727f5-4b48-40fa-aa72-32c35891deec tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:36.256269 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-812727f5-4b48-40fa-aa72-32c35891deec tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:36.256714 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-812727f5-4b48-40fa-aa72-32c35891deec tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:36.257471 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-812727f5-4b48-40fa-aa72-32c35891deec tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:36.257895 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-812727f5-4b48-40fa-aa72-32c35891deec tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:36.274230 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-4e1e6329-6726-48f1-ac2f-298f43c0972b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:36.282439 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-4e1e6329-6726-48f1-ac2f-298f43c0972b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.149031 Oct 12 04:19:36.283166 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 251/511] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:36 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:36.389320 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-812727f5-4b48-40fa-aa72-32c35891deec tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:36.397520 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-812727f5-4b48-40fa-aa72-32c35891deec tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 200 len: 1514 microversion: 2.1 time: 0.151934 Oct 12 04:19:36.398097 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 261/512] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:36 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:36.837200 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-95c9470d-d662-4b4b-8a91-6d97a097e916 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:36.837917 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-95c9470d-d662-4b4b-8a91-6d97a097e916 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:36.844391 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-95c9470d-d662-4b4b-8a91-6d97a097e916 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:36.845219 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-95c9470d-d662-4b4b-8a91-6d97a097e916 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:36.845606 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-95c9470d-d662-4b4b-8a91-6d97a097e916 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:36.846037 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-95c9470d-d662-4b4b-8a91-6d97a097e916 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:36.976885 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-95c9470d-d662-4b4b-8a91-6d97a097e916 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:37.003798 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-95c9470d-d662-4b4b-8a91-6d97a097e916 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:37.006436 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-95c9470d-d662-4b4b-8a91-6d97a097e916 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:37.007642 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-95c9470d-d662-4b4b-8a91-6d97a097e916 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1807 microversion: 2.20 time: 0.174157 Oct 12 04:19:37.008402 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 252/513] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:36 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:37.299121 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-0802893f-89b4-4ee1-abf6-4253ae3f7bad tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:37.299716 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-0802893f-89b4-4ee1-abf6-4253ae3f7bad tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:37.306164 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0802893f-89b4-4ee1-abf6-4253ae3f7bad tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:37.306601 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0802893f-89b4-4ee1-abf6-4253ae3f7bad tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:37.307379 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0802893f-89b4-4ee1-abf6-4253ae3f7bad tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:37.307804 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0802893f-89b4-4ee1-abf6-4253ae3f7bad tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:37.413940 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-2640c7d9-45d0-47fb-a51a-74bd62441923 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:37.414557 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-2640c7d9-45d0-47fb-a51a-74bd62441923 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:37.420756 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2640c7d9-45d0-47fb-a51a-74bd62441923 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:37.421389 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2640c7d9-45d0-47fb-a51a-74bd62441923 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:37.422307 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2640c7d9-45d0-47fb-a51a-74bd62441923 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:37.422907 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2640c7d9-45d0-47fb-a51a-74bd62441923 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:37.631582 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-0802893f-89b4-4ee1-abf6-4253ae3f7bad tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:37.642033 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-0802893f-89b4-4ee1-abf6-4253ae3f7bad tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.346467 Oct 12 04:19:37.642825 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 262/514] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:37 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:37.760557 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-2640c7d9-45d0-47fb-a51a-74bd62441923 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:37.776147 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-2640c7d9-45d0-47fb-a51a-74bd62441923 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 200 len: 1514 microversion: 2.1 time: 0.366513 Oct 12 04:19:37.777464 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 253/515] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:37 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 1514 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:38.027530 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-b8df33d7-8573-4a4c-8865-435716fed2f5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:38.031508 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-b8df33d7-8573-4a4c-8865-435716fed2f5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:38.046807 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b8df33d7-8573-4a4c-8865-435716fed2f5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:38.047298 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b8df33d7-8573-4a4c-8865-435716fed2f5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:38.048771 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b8df33d7-8573-4a4c-8865-435716fed2f5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:38.049501 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b8df33d7-8573-4a4c-8865-435716fed2f5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:38.207837 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-b8df33d7-8573-4a4c-8865-435716fed2f5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:38.220207 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-b8df33d7-8573-4a4c-8865-435716fed2f5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:38.221899 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-b8df33d7-8573-4a4c-8865-435716fed2f5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:38.223271 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-b8df33d7-8573-4a4c-8865-435716fed2f5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1807 microversion: 2.20 time: 0.201389 Oct 12 04:19:38.224682 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 263/516] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:38 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1807 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:38.347560 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-f310f999-1056-4c2d-819b-c1b0bbafee19 req-f6ed343a-9bbc-482c-8aab-b5f74024e71e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cb93a9d-e260-48a6-a220-3f8b2af0dfaa", "name": "network-vif-deleted", "tag": "701f461a-d960-4813-9dcc-a65b3c60f07b"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:19:38.349681 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:19:38.349681 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:19:38.369537 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-f310f999-1056-4c2d-819b-c1b0bbafee19 req-f6ed343a-9bbc-482c-8aab-b5f74024e71e service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:38.369979 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-f310f999-1056-4c2d-819b-c1b0bbafee19 req-f6ed343a-9bbc-482c-8aab-b5f74024e71e service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:38.385890 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-f310f999-1056-4c2d-819b-c1b0bbafee19 req-f6ed343a-9bbc-482c-8aab-b5f74024e71e service nova] Creating event network-vif-deleted:701f461a-d960-4813-9dcc-a65b3c60f07b for instance 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa on hv-cinder-81306 Oct 12 04:19:38.392208 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-f310f999-1056-4c2d-819b-c1b0bbafee19 req-f6ed343a-9bbc-482c-8aab-b5f74024e71e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049419 Oct 12 04:19:38.393395 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 254/517] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:19:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:19:38.660648 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-e57a2ae9-cca2-4e54-840a-80c5dee74b2d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:38.661336 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-e57a2ae9-cca2-4e54-840a-80c5dee74b2d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:38.667224 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e57a2ae9-cca2-4e54-840a-80c5dee74b2d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:38.667671 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e57a2ae9-cca2-4e54-840a-80c5dee74b2d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:38.668442 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e57a2ae9-cca2-4e54-840a-80c5dee74b2d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:38.668873 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e57a2ae9-cca2-4e54-840a-80c5dee74b2d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:38.793817 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-e06f81fc-c152-4ce9-9604-31a8df70f7ad tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:38.794521 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-e06f81fc-c152-4ce9-9604-31a8df70f7ad tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:38.801023 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e06f81fc-c152-4ce9-9604-31a8df70f7ad tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:38.801478 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e06f81fc-c152-4ce9-9604-31a8df70f7ad tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:38.802960 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e06f81fc-c152-4ce9-9604-31a8df70f7ad tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:38.803392 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e06f81fc-c152-4ce9-9604-31a8df70f7ad tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:38.806551 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-e57a2ae9-cca2-4e54-840a-80c5dee74b2d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:38.815497 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-e57a2ae9-cca2-4e54-840a-80c5dee74b2d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.158265 Oct 12 04:19:38.825621 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 264/518] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:38 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:38.872581 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-e06f81fc-c152-4ce9-9604-31a8df70f7ad tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:38.883159 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-e06f81fc-c152-4ce9-9604-31a8df70f7ad tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 200 len: 1472 microversion: 2.1 time: 0.093411 Oct 12 04:19:38.883793 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 255/519] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:38 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 1472 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:39.242156 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-1990a611-a1ba-443a-b886-37ce2296900c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:39.242782 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-1990a611-a1ba-443a-b886-37ce2296900c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:39.249032 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1990a611-a1ba-443a-b886-37ce2296900c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:39.255468 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1990a611-a1ba-443a-b886-37ce2296900c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:39.255468 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1990a611-a1ba-443a-b886-37ce2296900c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:39.255468 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1990a611-a1ba-443a-b886-37ce2296900c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:39.427269 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-1990a611-a1ba-443a-b886-37ce2296900c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:39.441315 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-1990a611-a1ba-443a-b886-37ce2296900c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:39.443783 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-1990a611-a1ba-443a-b886-37ce2296900c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:39.445430 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-1990a611-a1ba-443a-b886-37ce2296900c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1807 microversion: 2.20 time: 0.206991 Oct 12 04:19:39.447576 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 265/520] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:39 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1807 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:39.834610 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-f1583dfd-216d-454a-8914-029d346a5e66 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:39.836112 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-f1583dfd-216d-454a-8914-029d346a5e66 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:39.842346 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f1583dfd-216d-454a-8914-029d346a5e66 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:39.843131 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f1583dfd-216d-454a-8914-029d346a5e66 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:39.844109 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f1583dfd-216d-454a-8914-029d346a5e66 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:39.844849 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f1583dfd-216d-454a-8914-029d346a5e66 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:39.901628 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-6030a121-42d2-4176-83a1-2d39d9ad5659 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:39.902454 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-6030a121-42d2-4176-83a1-2d39d9ad5659 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:39.913863 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6030a121-42d2-4176-83a1-2d39d9ad5659 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:39.914320 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6030a121-42d2-4176-83a1-2d39d9ad5659 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:39.916775 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6030a121-42d2-4176-83a1-2d39d9ad5659 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:39.917616 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6030a121-42d2-4176-83a1-2d39d9ad5659 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:40.017920 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-6030a121-42d2-4176-83a1-2d39d9ad5659 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:40.020416 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-f1583dfd-216d-454a-8914-029d346a5e66 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:40.029637 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-6030a121-42d2-4176-83a1-2d39d9ad5659 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 200 len: 1472 microversion: 2.1 time: 0.132457 Oct 12 04:19:40.030211 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 266/521] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:39 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 1472 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:40.032134 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-f1583dfd-216d-454a-8914-029d346a5e66 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.202146 Oct 12 04:19:40.033295 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 256/522] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:39 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:40.470464 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-005ce8cc-1fd0-46a0-bc2c-8e48a18580ac tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:40.471282 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-005ce8cc-1fd0-46a0-bc2c-8e48a18580ac tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:40.477969 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-005ce8cc-1fd0-46a0-bc2c-8e48a18580ac tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:40.479514 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-005ce8cc-1fd0-46a0-bc2c-8e48a18580ac tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:40.479514 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-005ce8cc-1fd0-46a0-bc2c-8e48a18580ac tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:40.479719 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-005ce8cc-1fd0-46a0-bc2c-8e48a18580ac tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:40.683788 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-005ce8cc-1fd0-46a0-bc2c-8e48a18580ac tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:40.683788 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-005ce8cc-1fd0-46a0-bc2c-8e48a18580ac tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:40.685183 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-005ce8cc-1fd0-46a0-bc2c-8e48a18580ac tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:40.685183 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-005ce8cc-1fd0-46a0-bc2c-8e48a18580ac tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1807 microversion: 2.20 time: 0.203661 Oct 12 04:19:40.685183 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 267/523] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:40 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:19:41.046503 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-32ce3793-2acf-407d-8571-c6b4e5761bfe tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:41.048003 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-32ce3793-2acf-407d-8571-c6b4e5761bfe tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:41.049120 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-1d9a0cc8-9cbe-45fb-9c96-ac38aae07c53 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:41.049733 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-1d9a0cc8-9cbe-45fb-9c96-ac38aae07c53 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:41.054982 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-32ce3793-2acf-407d-8571-c6b4e5761bfe tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:41.055425 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-32ce3793-2acf-407d-8571-c6b4e5761bfe tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:41.055964 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1d9a0cc8-9cbe-45fb-9c96-ac38aae07c53 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:41.056191 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-32ce3793-2acf-407d-8571-c6b4e5761bfe tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:41.056361 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1d9a0cc8-9cbe-45fb-9c96-ac38aae07c53 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:41.056616 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-32ce3793-2acf-407d-8571-c6b4e5761bfe tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:41.057119 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1d9a0cc8-9cbe-45fb-9c96-ac38aae07c53 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:41.057553 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1d9a0cc8-9cbe-45fb-9c96-ac38aae07c53 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:41.172471 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-32ce3793-2acf-407d-8571-c6b4e5761bfe tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:41.186594 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-32ce3793-2acf-407d-8571-c6b4e5761bfe tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 200 len: 1472 microversion: 2.1 time: 0.143443 Oct 12 04:19:41.206475 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 257/524] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:41 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 1472 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:41.291442 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-1d9a0cc8-9cbe-45fb-9c96-ac38aae07c53 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:41.301122 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-1d9a0cc8-9cbe-45fb-9c96-ac38aae07c53 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.255657 Oct 12 04:19:41.301751 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 268/525] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:41 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:41.732454 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-def9e830-bb02-475f-ac11-b8510ba398c3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:41.732716 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-def9e830-bb02-475f-ac11-b8510ba398c3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:41.740447 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-def9e830-bb02-475f-ac11-b8510ba398c3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:41.740923 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-def9e830-bb02-475f-ac11-b8510ba398c3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:41.741716 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-def9e830-bb02-475f-ac11-b8510ba398c3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:41.742182 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-def9e830-bb02-475f-ac11-b8510ba398c3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:42.097073 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-def9e830-bb02-475f-ac11-b8510ba398c3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:42.105951 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-def9e830-bb02-475f-ac11-b8510ba398c3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:42.107574 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-def9e830-bb02-475f-ac11-b8510ba398c3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:42.108978 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-def9e830-bb02-475f-ac11-b8510ba398c3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1807 microversion: 2.20 time: 0.380589 Oct 12 04:19:42.120848 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 258/526] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:41 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1807 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:42.215175 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-f90369e5-ce99-4113-8fc7-67580324fd8c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:42.216444 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-f90369e5-ce99-4113-8fc7-67580324fd8c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:42.222639 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f90369e5-ce99-4113-8fc7-67580324fd8c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:42.223106 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f90369e5-ce99-4113-8fc7-67580324fd8c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:42.224415 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f90369e5-ce99-4113-8fc7-67580324fd8c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:42.224846 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f90369e5-ce99-4113-8fc7-67580324fd8c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:42.285417 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-f90369e5-ce99-4113-8fc7-67580324fd8c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:42.293408 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-f90369e5-ce99-4113-8fc7-67580324fd8c tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 200 len: 1472 microversion: 2.1 time: 0.081835 Oct 12 04:19:42.293958 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 269/527] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:42 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 1472 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:42.317063 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-954c6f22-dd40-4353-b63f-699080734919 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:42.317685 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-954c6f22-dd40-4353-b63f-699080734919 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:42.323443 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-954c6f22-dd40-4353-b63f-699080734919 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:42.323883 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-954c6f22-dd40-4353-b63f-699080734919 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:42.324628 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-954c6f22-dd40-4353-b63f-699080734919 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:42.325053 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-954c6f22-dd40-4353-b63f-699080734919 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:42.446871 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-954c6f22-dd40-4353-b63f-699080734919 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:42.454402 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-954c6f22-dd40-4353-b63f-699080734919 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.141153 Oct 12 04:19:42.454982 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 259/528] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:42 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:43.127187 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-9e909d1a-f513-452d-83cb-c7620adb7668 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:43.128124 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-9e909d1a-f513-452d-83cb-c7620adb7668 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:43.135139 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9e909d1a-f513-452d-83cb-c7620adb7668 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:43.135846 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9e909d1a-f513-452d-83cb-c7620adb7668 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:43.136811 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9e909d1a-f513-452d-83cb-c7620adb7668 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:43.137248 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9e909d1a-f513-452d-83cb-c7620adb7668 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:43.260563 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-9e909d1a-f513-452d-83cb-c7620adb7668 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:43.268787 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-9e909d1a-f513-452d-83cb-c7620adb7668 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:43.270285 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-9e909d1a-f513-452d-83cb-c7620adb7668 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:43.271434 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-9e909d1a-f513-452d-83cb-c7620adb7668 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1807 microversion: 2.20 time: 0.147941 Oct 12 04:19:43.272625 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 270/529] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:43 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:43.310510 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-4ef6d364-2583-4402-b253-8550a402d9e1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:43.311159 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-4ef6d364-2583-4402-b253-8550a402d9e1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:43.317177 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4ef6d364-2583-4402-b253-8550a402d9e1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:43.317640 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4ef6d364-2583-4402-b253-8550a402d9e1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:43.318402 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4ef6d364-2583-4402-b253-8550a402d9e1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:43.319448 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4ef6d364-2583-4402-b253-8550a402d9e1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:43.379930 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-4ef6d364-2583-4402-b253-8550a402d9e1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:43.387644 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-4ef6d364-2583-4402-b253-8550a402d9e1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 200 len: 1472 microversion: 2.1 time: 0.080811 Oct 12 04:19:43.388202 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 260/530] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:43 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 1472 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:43.472401 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-0cc52578-ac4f-4875-83c2-5c29d856575c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:43.473406 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-0cc52578-ac4f-4875-83c2-5c29d856575c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:43.479387 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0cc52578-ac4f-4875-83c2-5c29d856575c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:43.479826 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0cc52578-ac4f-4875-83c2-5c29d856575c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:43.480573 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0cc52578-ac4f-4875-83c2-5c29d856575c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:43.480996 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0cc52578-ac4f-4875-83c2-5c29d856575c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:43.606052 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-0cc52578-ac4f-4875-83c2-5c29d856575c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:43.613880 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-0cc52578-ac4f-4875-83c2-5c29d856575c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.146344 Oct 12 04:19:43.614544 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 271/531] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:43 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:44.290714 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-5ac4a3b5-7050-4a9a-8d42-0d97452767ed tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:44.291363 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-5ac4a3b5-7050-4a9a-8d42-0d97452767ed tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:44.297253 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5ac4a3b5-7050-4a9a-8d42-0d97452767ed tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:44.297693 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5ac4a3b5-7050-4a9a-8d42-0d97452767ed tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:44.298446 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5ac4a3b5-7050-4a9a-8d42-0d97452767ed tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:44.298898 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5ac4a3b5-7050-4a9a-8d42-0d97452767ed tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:44.407228 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-262a5183-97de-46e3-85d4-b9d76eff3194 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:44.408115 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-262a5183-97de-46e3-85d4-b9d76eff3194 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:44.413845 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-262a5183-97de-46e3-85d4-b9d76eff3194 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:44.414293 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-262a5183-97de-46e3-85d4-b9d76eff3194 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:44.415105 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-262a5183-97de-46e3-85d4-b9d76eff3194 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:44.415539 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-262a5183-97de-46e3-85d4-b9d76eff3194 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:44.425716 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-5ac4a3b5-7050-4a9a-8d42-0d97452767ed tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:44.434172 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-5ac4a3b5-7050-4a9a-8d42-0d97452767ed tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:44.435694 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-5ac4a3b5-7050-4a9a-8d42-0d97452767ed tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:44.436842 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-5ac4a3b5-7050-4a9a-8d42-0d97452767ed tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1807 microversion: 2.20 time: 0.150457 Oct 12 04:19:44.438079 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 261/532] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:44 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:44.495904 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-262a5183-97de-46e3-85d4-b9d76eff3194 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:44.503917 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-262a5183-97de-46e3-85d4-b9d76eff3194 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 200 len: 1472 microversion: 2.1 time: 0.102687 Oct 12 04:19:44.504538 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 272/533] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:44 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 1472 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:44.631376 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-be15dd28-36d0-4c25-8674-620a77575b33 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:44.632545 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-be15dd28-36d0-4c25-8674-620a77575b33 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:44.638547 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-be15dd28-36d0-4c25-8674-620a77575b33 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:44.639030 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-be15dd28-36d0-4c25-8674-620a77575b33 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:44.639808 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-be15dd28-36d0-4c25-8674-620a77575b33 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:44.640252 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-be15dd28-36d0-4c25-8674-620a77575b33 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:44.767801 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-be15dd28-36d0-4c25-8674-620a77575b33 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:44.776270 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-be15dd28-36d0-4c25-8674-620a77575b33 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.148525 Oct 12 04:19:44.776834 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 262/534] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:44 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:45.455325 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-8ae23bd1-b186-43c9-a64d-2d366743e0b1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:45.456031 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-8ae23bd1-b186-43c9-a64d-2d366743e0b1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:45.461705 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8ae23bd1-b186-43c9-a64d-2d366743e0b1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:45.462141 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8ae23bd1-b186-43c9-a64d-2d366743e0b1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:45.462977 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8ae23bd1-b186-43c9-a64d-2d366743e0b1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:45.463327 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8ae23bd1-b186-43c9-a64d-2d366743e0b1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:45.523194 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-1fca957d-e945-4f4b-bcf9-f902eead702d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:45.529223 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-1fca957d-e945-4f4b-bcf9-f902eead702d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:45.530550 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1fca957d-e945-4f4b-bcf9-f902eead702d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:45.531048 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1fca957d-e945-4f4b-bcf9-f902eead702d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:45.531886 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1fca957d-e945-4f4b-bcf9-f902eead702d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:45.532248 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1fca957d-e945-4f4b-bcf9-f902eead702d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:45.613664 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-1fca957d-e945-4f4b-bcf9-f902eead702d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:45.620940 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-1fca957d-e945-4f4b-bcf9-f902eead702d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 200 len: 1472 microversion: 2.1 time: 0.101995 Oct 12 04:19:45.621525 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 263/535] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:45 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 1472 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:19:45.626194 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-8ae23bd1-b186-43c9-a64d-2d366743e0b1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:45.634272 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-8ae23bd1-b186-43c9-a64d-2d366743e0b1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:45.635818 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-8ae23bd1-b186-43c9-a64d-2d366743e0b1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:45.636962 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-8ae23bd1-b186-43c9-a64d-2d366743e0b1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1807 microversion: 2.20 time: 0.185306 Oct 12 04:19:45.637607 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 273/536] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:45 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:45.793597 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-64aa660f-a682-404b-b4b9-dfff56cbdb11 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:45.794204 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-64aa660f-a682-404b-b4b9-dfff56cbdb11 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:45.800070 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-64aa660f-a682-404b-b4b9-dfff56cbdb11 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:45.800513 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-64aa660f-a682-404b-b4b9-dfff56cbdb11 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:45.801272 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-64aa660f-a682-404b-b4b9-dfff56cbdb11 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:45.801706 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-64aa660f-a682-404b-b4b9-dfff56cbdb11 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:45.927114 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-64aa660f-a682-404b-b4b9-dfff56cbdb11 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:45.958943 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-64aa660f-a682-404b-b4b9-dfff56cbdb11 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.162012 Oct 12 04:19:45.958943 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 264/537] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:45 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:19:46.637797 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-e3568500-8fc1-4be6-8be4-ca2da9d42f87 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:46.638468 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-e3568500-8fc1-4be6-8be4-ca2da9d42f87 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:46.644448 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e3568500-8fc1-4be6-8be4-ca2da9d42f87 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:46.644899 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e3568500-8fc1-4be6-8be4-ca2da9d42f87 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:46.645691 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e3568500-8fc1-4be6-8be4-ca2da9d42f87 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:46.646141 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e3568500-8fc1-4be6-8be4-ca2da9d42f87 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:46.655845 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-9c6cb6cb-db8a-40ca-870e-67615cdd49b4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:46.657290 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-9c6cb6cb-db8a-40ca-870e-67615cdd49b4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:46.663461 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9c6cb6cb-db8a-40ca-870e-67615cdd49b4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:46.664450 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9c6cb6cb-db8a-40ca-870e-67615cdd49b4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:46.665471 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9c6cb6cb-db8a-40ca-870e-67615cdd49b4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:46.665972 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9c6cb6cb-db8a-40ca-870e-67615cdd49b4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:46.708675 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-e3568500-8fc1-4be6-8be4-ca2da9d42f87 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:46.716787 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-e3568500-8fc1-4be6-8be4-ca2da9d42f87 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 200 len: 1472 microversion: 2.1 time: 0.082606 Oct 12 04:19:46.717743 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 274/538] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:46 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 1472 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:46.802294 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-9c6cb6cb-db8a-40ca-870e-67615cdd49b4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:46.811267 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-9c6cb6cb-db8a-40ca-870e-67615cdd49b4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:46.812769 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-9c6cb6cb-db8a-40ca-870e-67615cdd49b4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:46.813939 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-9c6cb6cb-db8a-40ca-870e-67615cdd49b4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1807 microversion: 2.20 time: 0.161816 Oct 12 04:19:46.814494 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 265/539] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:46 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:46.969841 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-77fd5b66-ebd5-4eff-ae67-e6c38a6b037f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:46.970390 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-77fd5b66-ebd5-4eff-ae67-e6c38a6b037f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:46.977049 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-77fd5b66-ebd5-4eff-ae67-e6c38a6b037f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:46.977494 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-77fd5b66-ebd5-4eff-ae67-e6c38a6b037f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:46.978258 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-77fd5b66-ebd5-4eff-ae67-e6c38a6b037f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:46.978715 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-77fd5b66-ebd5-4eff-ae67-e6c38a6b037f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:47.128915 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-77fd5b66-ebd5-4eff-ae67-e6c38a6b037f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:47.136527 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-77fd5b66-ebd5-4eff-ae67-e6c38a6b037f tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.170774 Oct 12 04:19:47.137081 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 275/540] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:46 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:47.734282 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-a80cfbfb-5da5-48a2-ac71-6cbc32790da5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:47.735626 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-a80cfbfb-5da5-48a2-ac71-6cbc32790da5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:47.742290 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a80cfbfb-5da5-48a2-ac71-6cbc32790da5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:47.742821 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a80cfbfb-5da5-48a2-ac71-6cbc32790da5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:47.743739 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a80cfbfb-5da5-48a2-ac71-6cbc32790da5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:47.744202 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a80cfbfb-5da5-48a2-ac71-6cbc32790da5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:47.805233 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-a80cfbfb-5da5-48a2-ac71-6cbc32790da5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:47.815434 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-a80cfbfb-5da5-48a2-ac71-6cbc32790da5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 200 len: 1472 microversion: 2.1 time: 0.085502 Oct 12 04:19:47.816111 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 266/541] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:47 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 1472 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:47.832618 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-453df6e6-cc09-4ae4-8828-936f20d293d4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:47.833338 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-453df6e6-cc09-4ae4-8828-936f20d293d4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:47.839155 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-453df6e6-cc09-4ae4-8828-936f20d293d4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:47.839854 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-453df6e6-cc09-4ae4-8828-936f20d293d4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:47.840827 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-453df6e6-cc09-4ae4-8828-936f20d293d4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:47.841514 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-453df6e6-cc09-4ae4-8828-936f20d293d4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:47.967047 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-453df6e6-cc09-4ae4-8828-936f20d293d4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:47.975097 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-453df6e6-cc09-4ae4-8828-936f20d293d4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:47.976584 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-453df6e6-cc09-4ae4-8828-936f20d293d4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:47.977727 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-453df6e6-cc09-4ae4-8828-936f20d293d4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1807 microversion: 2.20 time: 0.148815 Oct 12 04:19:47.978271 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 276/542] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:47 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:48.154093 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-13f5e843-26d3-4269-809a-b286973c53f7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:48.155281 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-13f5e843-26d3-4269-809a-b286973c53f7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:48.161837 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-13f5e843-26d3-4269-809a-b286973c53f7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:48.165283 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-13f5e843-26d3-4269-809a-b286973c53f7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:48.165283 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-13f5e843-26d3-4269-809a-b286973c53f7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:48.165283 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-13f5e843-26d3-4269-809a-b286973c53f7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:48.332921 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-13f5e843-26d3-4269-809a-b286973c53f7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:48.332921 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-13f5e843-26d3-4269-809a-b286973c53f7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.172673 Oct 12 04:19:48.332921 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 267/543] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:48 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:48.834436 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-85111855-07e1-4f6c-8271-ba26a52aa4cd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:48.835166 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-85111855-07e1-4f6c-8271-ba26a52aa4cd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:48.841733 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-85111855-07e1-4f6c-8271-ba26a52aa4cd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:48.842253 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-85111855-07e1-4f6c-8271-ba26a52aa4cd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:48.843058 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-85111855-07e1-4f6c-8271-ba26a52aa4cd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:48.843488 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-85111855-07e1-4f6c-8271-ba26a52aa4cd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:48.904535 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-85111855-07e1-4f6c-8271-ba26a52aa4cd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:48.912272 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-85111855-07e1-4f6c-8271-ba26a52aa4cd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 200 len: 1472 microversion: 2.1 time: 0.082218 Oct 12 04:19:48.912920 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 277/544] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:48 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 1472 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:48.995538 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-a9549178-872d-4f0a-bf5c-dc577144e102 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:48.996140 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-a9549178-872d-4f0a-bf5c-dc577144e102 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:49.002128 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a9549178-872d-4f0a-bf5c-dc577144e102 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:49.002569 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a9549178-872d-4f0a-bf5c-dc577144e102 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:49.003338 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a9549178-872d-4f0a-bf5c-dc577144e102 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:49.003761 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a9549178-872d-4f0a-bf5c-dc577144e102 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:49.129115 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-a9549178-872d-4f0a-bf5c-dc577144e102 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:49.138117 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-a9549178-872d-4f0a-bf5c-dc577144e102 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:49.139711 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-a9549178-872d-4f0a-bf5c-dc577144e102 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:49.140924 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-a9549178-872d-4f0a-bf5c-dc577144e102 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1807 microversion: 2.20 time: 0.149148 Oct 12 04:19:49.141541 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 268/545] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:48 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:49.340906 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-6271d61a-78ae-4572-a909-50289521f46c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:49.341508 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-6271d61a-78ae-4572-a909-50289521f46c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:49.347192 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6271d61a-78ae-4572-a909-50289521f46c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:49.347639 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6271d61a-78ae-4572-a909-50289521f46c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:49.348388 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6271d61a-78ae-4572-a909-50289521f46c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:49.348812 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6271d61a-78ae-4572-a909-50289521f46c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:49.499170 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-6271d61a-78ae-4572-a909-50289521f46c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:49.507094 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-6271d61a-78ae-4572-a909-50289521f46c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.169723 Oct 12 04:19:49.508388 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 278/546] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:49 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:49.928998 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-349d5ce8-dffb-4838-8b7d-674bd569b6ab tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:49.930378 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-349d5ce8-dffb-4838-8b7d-674bd569b6ab tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:49.936083 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-349d5ce8-dffb-4838-8b7d-674bd569b6ab tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:49.936518 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-349d5ce8-dffb-4838-8b7d-674bd569b6ab tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:49.937303 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-349d5ce8-dffb-4838-8b7d-674bd569b6ab tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:49.937725 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-349d5ce8-dffb-4838-8b7d-674bd569b6ab tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:49.966450 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-349d5ce8-dffb-4838-8b7d-674bd569b6ab tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:49.966943 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-349d5ce8-dffb-4838-8b7d-674bd569b6ab tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:49.967384 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.objects.instance [None req-349d5ce8-dffb-4838-8b7d-674bd569b6ab tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lazy-loading 'fault' on Instance uuid 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa {{(pid=108898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:19:50.005731 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-349d5ce8-dffb-4838-8b7d-674bd569b6ab tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:50.013142 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-349d5ce8-dffb-4838-8b7d-674bd569b6ab tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 200 len: 1308 microversion: 2.1 time: 0.087772 Oct 12 04:19:50.014447 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 269/547] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:49 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 1308 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:50.159667 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-87d7f3d4-25b0-4737-97f1-2b960e299b00 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:50.160383 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-87d7f3d4-25b0-4737-97f1-2b960e299b00 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:50.167219 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-87d7f3d4-25b0-4737-97f1-2b960e299b00 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:50.167750 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-87d7f3d4-25b0-4737-97f1-2b960e299b00 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:50.168594 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-87d7f3d4-25b0-4737-97f1-2b960e299b00 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:50.169149 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-87d7f3d4-25b0-4737-97f1-2b960e299b00 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:50.287838 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-87d7f3d4-25b0-4737-97f1-2b960e299b00 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:50.297382 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-87d7f3d4-25b0-4737-97f1-2b960e299b00 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:50.298344 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-87d7f3d4-25b0-4737-97f1-2b960e299b00 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:50.299516 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-87d7f3d4-25b0-4737-97f1-2b960e299b00 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1807 microversion: 2.20 time: 0.143886 Oct 12 04:19:50.300050 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 279/548] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:50 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1807 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:50.524467 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-121e600d-617f-4d35-b1a4-c5b55ba05af3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:50.524975 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-121e600d-617f-4d35-b1a4-c5b55ba05af3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:50.530703 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-121e600d-617f-4d35-b1a4-c5b55ba05af3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:50.531149 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-121e600d-617f-4d35-b1a4-c5b55ba05af3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:50.531910 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-121e600d-617f-4d35-b1a4-c5b55ba05af3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:50.532341 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-121e600d-617f-4d35-b1a4-c5b55ba05af3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:50.661317 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-121e600d-617f-4d35-b1a4-c5b55ba05af3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:50.670451 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-121e600d-617f-4d35-b1a4-c5b55ba05af3 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.150405 Oct 12 04:19:50.671037 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 270/549] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:50 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:51.029871 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-13048913-e801-4692-945b-af75fb7eb700 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:51.030484 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-13048913-e801-4692-945b-af75fb7eb700 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:51.036262 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-13048913-e801-4692-945b-af75fb7eb700 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:51.036702 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-13048913-e801-4692-945b-af75fb7eb700 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:51.037451 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-13048913-e801-4692-945b-af75fb7eb700 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:51.037879 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-13048913-e801-4692-945b-af75fb7eb700 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:51.051225 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.wsgi [None req-13048913-e801-4692-945b-af75fb7eb700 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] HTTP exception thrown: Instance 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa could not be found. Oct 12 04:19:51.051803 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-13048913-e801-4692-945b-af75fb7eb700 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Returning 404 to user: Instance 1cb93a9d-e260-48a6-a220-3f8b2af0dfaa could not be found. {{(pid=108897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:19:51.052599 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-13048913-e801-4692-945b-af75fb7eb700 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa" status: 404 len: 111 microversion: 2.1 time: 0.026469 Oct 12 04:19:51.053100 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 280/550] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:51 2021] GET /compute/v2.1/servers/1cb93a9d-e260-48a6-a220-3f8b2af0dfaa => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:19:51.060729 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-2666e0de-8d17-4166-8a3f-f0fdcd045958 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:51.061214 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-2666e0de-8d17-4166-8a3f-f0fdcd045958 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: ce6b1d1f-abeb-4ab7-a402-c003f0171210] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:51.066960 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2666e0de-8d17-4166-8a3f-f0fdcd045958 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:51.067407 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2666e0de-8d17-4166-8a3f-f0fdcd045958 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:51.068162 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2666e0de-8d17-4166-8a3f-f0fdcd045958 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:51.068590 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2666e0de-8d17-4166-8a3f-f0fdcd045958 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:51.092188 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-2666e0de-8d17-4166-8a3f-f0fdcd045958 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: ce6b1d1f-abeb-4ab7-a402-c003f0171210] Going to try to terminate instance {{(pid=108898) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 04:19:51.317104 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-3e227fd4-96e8-4286-b2f3-801d3e683695 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:51.317706 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-3e227fd4-96e8-4286-b2f3-801d3e683695 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:51.323896 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3e227fd4-96e8-4286-b2f3-801d3e683695 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:51.324339 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3e227fd4-96e8-4286-b2f3-801d3e683695 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:51.325095 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3e227fd4-96e8-4286-b2f3-801d3e683695 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:51.325523 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3e227fd4-96e8-4286-b2f3-801d3e683695 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:51.356652 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-2666e0de-8d17-4166-8a3f-f0fdcd045958 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "DELETE /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210" status: 204 len: 0 microversion: 2.1 time: 0.299301 Oct 12 04:19:51.357235 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 271/551] 10.222.0.21 () {58 vars in 1238 bytes} [Tue Oct 12 04:19:51 2021] DELETE /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 04:19:51.365409 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-f2fb14a1-bbab-45aa-8588-5e9ada35dafd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:51.366194 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-f2fb14a1-bbab-45aa-8588-5e9ada35dafd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: ce6b1d1f-abeb-4ab7-a402-c003f0171210] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:51.371995 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f2fb14a1-bbab-45aa-8588-5e9ada35dafd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:51.372440 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f2fb14a1-bbab-45aa-8588-5e9ada35dafd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:51.373201 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f2fb14a1-bbab-45aa-8588-5e9ada35dafd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:51.373632 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f2fb14a1-bbab-45aa-8588-5e9ada35dafd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:51.469390 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-3e227fd4-96e8-4286-b2f3-801d3e683695 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:51.477688 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-3e227fd4-96e8-4286-b2f3-801d3e683695 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:51.479213 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-3e227fd4-96e8-4286-b2f3-801d3e683695 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:51.480349 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-3e227fd4-96e8-4286-b2f3-801d3e683695 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1807 microversion: 2.20 time: 0.166935 Oct 12 04:19:51.481081 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 281/552] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:51 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:19:51.519365 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-f2fb14a1-bbab-45aa-8588-5e9ada35dafd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:51.526543 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-f2fb14a1-bbab-45aa-8588-5e9ada35dafd tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210" status: 200 len: 1513 microversion: 2.1 time: 0.164905 Oct 12 04:19:51.527129 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 272/553] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:51 2021] GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:19:51.693275 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ec138791-3a0a-43e4-b44d-6a23661d1c3d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:51.693801 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ec138791-3a0a-43e4-b44d-6a23661d1c3d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:51.700157 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ec138791-3a0a-43e4-b44d-6a23661d1c3d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:51.700603 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ec138791-3a0a-43e4-b44d-6a23661d1c3d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:51.701362 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ec138791-3a0a-43e4-b44d-6a23661d1c3d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:51.701793 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ec138791-3a0a-43e4-b44d-6a23661d1c3d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:51.818980 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-ec138791-3a0a-43e4-b44d-6a23661d1c3d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:51.827592 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ec138791-3a0a-43e4-b44d-6a23661d1c3d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1567 microversion: 2.1 time: 0.137971 Oct 12 04:19:51.828149 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 282/554] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:51 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1567 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:52.497769 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-49137e3e-34b8-44a5-870d-6146fef9c927 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:52.498368 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-49137e3e-34b8-44a5-870d-6146fef9c927 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:52.504130 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-49137e3e-34b8-44a5-870d-6146fef9c927 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:52.504571 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-49137e3e-34b8-44a5-870d-6146fef9c927 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:52.505320 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-49137e3e-34b8-44a5-870d-6146fef9c927 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:52.505744 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-49137e3e-34b8-44a5-870d-6146fef9c927 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:52.543706 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ad84ee57-b9ed-4c2a-8ba4-62d2b3350267 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:52.544309 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ad84ee57-b9ed-4c2a-8ba4-62d2b3350267 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: ce6b1d1f-abeb-4ab7-a402-c003f0171210] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:52.550033 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ad84ee57-b9ed-4c2a-8ba4-62d2b3350267 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:52.550476 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ad84ee57-b9ed-4c2a-8ba4-62d2b3350267 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:52.551273 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ad84ee57-b9ed-4c2a-8ba4-62d2b3350267 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:52.551707 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ad84ee57-b9ed-4c2a-8ba4-62d2b3350267 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:52.652172 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-49137e3e-34b8-44a5-870d-6146fef9c927 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:52.660406 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-49137e3e-34b8-44a5-870d-6146fef9c927 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:52.661886 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-49137e3e-34b8-44a5-870d-6146fef9c927 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:52.663051 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-49137e3e-34b8-44a5-870d-6146fef9c927 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1807 microversion: 2.20 time: 0.168960 Oct 12 04:19:52.663646 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 273/555] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:52 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:52.700702 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-ad84ee57-b9ed-4c2a-8ba4-62d2b3350267 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:52.708120 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ad84ee57-b9ed-4c2a-8ba4-62d2b3350267 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210" status: 200 len: 1513 microversion: 2.1 time: 0.168014 Oct 12 04:19:52.708678 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 283/556] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:52 2021] GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:19:52.844097 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-6a1325ba-5540-4cbb-9d56-eefef9ca1187 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:52.844699 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-6a1325ba-5540-4cbb-9d56-eefef9ca1187 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:52.850424 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6a1325ba-5540-4cbb-9d56-eefef9ca1187 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:52.850903 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6a1325ba-5540-4cbb-9d56-eefef9ca1187 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:52.851721 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6a1325ba-5540-4cbb-9d56-eefef9ca1187 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:52.852143 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6a1325ba-5540-4cbb-9d56-eefef9ca1187 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:52.969338 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-6a1325ba-5540-4cbb-9d56-eefef9ca1187 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:52.977145 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-6a1325ba-5540-4cbb-9d56-eefef9ca1187 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1547 microversion: 2.1 time: 0.136656 Oct 12 04:19:52.977710 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 274/557] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:52 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1547 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:52.994175 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-1cf7eac5-0763-4412-b32b-3f0c21925891 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:52.994690 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-1cf7eac5-0763-4412-b32b-3f0c21925891 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:53.000242 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1cf7eac5-0763-4412-b32b-3f0c21925891 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:53.000685 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1cf7eac5-0763-4412-b32b-3f0c21925891 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:53.001428 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1cf7eac5-0763-4412-b32b-3f0c21925891 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:53.001884 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1cf7eac5-0763-4412-b32b-3f0c21925891 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:53.078098 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.wsgi [None req-1cf7eac5-0763-4412-b32b-3f0c21925891 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] HTTP exception thrown: Cannot 'detach_volume' instance d927fdb5-40b1-4279-9f0c-7006831e05d2 while it is in vm_state rescued Oct 12 04:19:53.078704 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-1cf7eac5-0763-4412-b32b-3f0c21925891 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Returning 409 to user: Cannot 'detach_volume' instance d927fdb5-40b1-4279-9f0c-7006831e05d2 while it is in vm_state rescued {{(pid=108897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:19:53.079520 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-1cf7eac5-0763-4412-b32b-3f0c21925891 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "DELETE /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2/os-volume_attachments/20bbc5f8-5aa7-493a-8d35-95a441725c6c" status: 409 len: 152 microversion: 2.1 time: 0.089923 Oct 12 04:19:53.080053 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 284/558] 10.222.0.21 () {58 vars in 1415 bytes} [Tue Oct 12 04:19:52 2021] DELETE /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2/os-volume_attachments/20bbc5f8-5aa7-493a-8d35-95a441725c6c => generated 152 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 04:19:53.088147 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-a06d4b6e-6443-448a-974f-0835be26dc99 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:19:53.088746 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-a06d4b6e-6443-448a-974f-0835be26dc99 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:53.094456 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a06d4b6e-6443-448a-974f-0835be26dc99 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:53.094938 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a06d4b6e-6443-448a-974f-0835be26dc99 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:53.095686 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a06d4b6e-6443-448a-974f-0835be26dc99 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:53.096107 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a06d4b6e-6443-448a-974f-0835be26dc99 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:53.309375 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-a06d4b6e-6443-448a-974f-0835be26dc99 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "POST /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2/action" status: 202 len: 0 microversion: 2.1 time: 0.224660 Oct 12 04:19:53.310250 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 275/559] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:19:53 2021] POST /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:19:53.318261 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-bb31835a-5aff-42c2-8d00-7f7682d52d81 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:53.318898 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-bb31835a-5aff-42c2-8d00-7f7682d52d81 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:53.325285 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bb31835a-5aff-42c2-8d00-7f7682d52d81 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:53.325731 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bb31835a-5aff-42c2-8d00-7f7682d52d81 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:53.326429 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bb31835a-5aff-42c2-8d00-7f7682d52d81 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:53.326882 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bb31835a-5aff-42c2-8d00-7f7682d52d81 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:53.465414 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-bb31835a-5aff-42c2-8d00-7f7682d52d81 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:53.473429 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-bb31835a-5aff-42c2-8d00-7f7682d52d81 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1555 microversion: 2.1 time: 0.158724 Oct 12 04:19:53.484520 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 285/560] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:53 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:53.508204 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-b208fda6-90ba-4385-833d-15e90be00d6c req-37302494-58cd-431c-ae59-9798ef2217fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce6b1d1f-abeb-4ab7-a402-c003f0171210", "name": "network-vif-deleted", "tag": "6fdf3f9d-d5b4-4906-8160-05e737485cfe"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:19:53.510047 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:19:53.510047 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:19:53.517368 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-b208fda6-90ba-4385-833d-15e90be00d6c req-37302494-58cd-431c-ae59-9798ef2217fd service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:53.517916 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-b208fda6-90ba-4385-833d-15e90be00d6c req-37302494-58cd-431c-ae59-9798ef2217fd service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:53.529106 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-b208fda6-90ba-4385-833d-15e90be00d6c req-37302494-58cd-431c-ae59-9798ef2217fd service nova] Creating event network-vif-deleted:6fdf3f9d-d5b4-4906-8160-05e737485cfe for instance ce6b1d1f-abeb-4ab7-a402-c003f0171210 on hv-cinder-81306 Oct 12 04:19:53.534471 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-b208fda6-90ba-4385-833d-15e90be00d6c req-37302494-58cd-431c-ae59-9798ef2217fd service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031218 Oct 12 04:19:53.535550 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 276/561] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:19:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:19:53.681387 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-094d92cc-adc2-4260-9a5d-069afbae7d30 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:53.681986 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-094d92cc-adc2-4260-9a5d-069afbae7d30 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:53.687924 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-094d92cc-adc2-4260-9a5d-069afbae7d30 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:53.688370 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-094d92cc-adc2-4260-9a5d-069afbae7d30 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:53.689126 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-094d92cc-adc2-4260-9a5d-069afbae7d30 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:53.689551 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-094d92cc-adc2-4260-9a5d-069afbae7d30 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:53.725464 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-2d9a2676-2749-486a-95b8-7521aefc7626 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:53.726643 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-2d9a2676-2749-486a-95b8-7521aefc7626 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: ce6b1d1f-abeb-4ab7-a402-c003f0171210] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:53.732624 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2d9a2676-2749-486a-95b8-7521aefc7626 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:53.733320 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2d9a2676-2749-486a-95b8-7521aefc7626 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:53.734273 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2d9a2676-2749-486a-95b8-7521aefc7626 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:53.734883 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2d9a2676-2749-486a-95b8-7521aefc7626 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:53.808401 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-2d9a2676-2749-486a-95b8-7521aefc7626 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:53.815615 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-2d9a2676-2749-486a-95b8-7521aefc7626 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210" status: 200 len: 1303 microversion: 2.1 time: 0.093987 Oct 12 04:19:53.820816 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 277/562] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:53 2021] GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210 => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:19:53.914388 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-094d92cc-adc2-4260-9a5d-069afbae7d30 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:53.922394 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-094d92cc-adc2-4260-9a5d-069afbae7d30 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:53.923911 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-094d92cc-adc2-4260-9a5d-069afbae7d30 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:53.925152 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-094d92cc-adc2-4260-9a5d-069afbae7d30 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1807 microversion: 2.20 time: 0.247914 Oct 12 04:19:53.925605 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 286/563] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:53 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1807 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:54.490411 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-89544eaf-a404-4bcb-9bbb-fc96c7bfa88e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:54.491076 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-89544eaf-a404-4bcb-9bbb-fc96c7bfa88e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:54.497450 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-89544eaf-a404-4bcb-9bbb-fc96c7bfa88e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:54.497939 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-89544eaf-a404-4bcb-9bbb-fc96c7bfa88e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:54.498741 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-89544eaf-a404-4bcb-9bbb-fc96c7bfa88e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:54.499176 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-89544eaf-a404-4bcb-9bbb-fc96c7bfa88e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:54.616409 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-89544eaf-a404-4bcb-9bbb-fc96c7bfa88e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:54.624453 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-89544eaf-a404-4bcb-9bbb-fc96c7bfa88e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1555 microversion: 2.1 time: 0.137773 Oct 12 04:19:54.625008 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 278/564] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:54 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1555 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:54.831897 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-8ec7c6f9-cdb4-4068-94be-ee113499ac1b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:54.832578 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-8ec7c6f9-cdb4-4068-94be-ee113499ac1b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: ce6b1d1f-abeb-4ab7-a402-c003f0171210] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:54.838407 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8ec7c6f9-cdb4-4068-94be-ee113499ac1b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:54.838879 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8ec7c6f9-cdb4-4068-94be-ee113499ac1b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:54.839626 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8ec7c6f9-cdb4-4068-94be-ee113499ac1b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:54.840051 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8ec7c6f9-cdb4-4068-94be-ee113499ac1b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:54.853338 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.wsgi [None req-8ec7c6f9-cdb4-4068-94be-ee113499ac1b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] HTTP exception thrown: Instance ce6b1d1f-abeb-4ab7-a402-c003f0171210 could not be found. Oct 12 04:19:54.853907 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-8ec7c6f9-cdb4-4068-94be-ee113499ac1b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Returning 404 to user: Instance ce6b1d1f-abeb-4ab7-a402-c003f0171210 could not be found. {{(pid=108897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:19:54.854793 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-8ec7c6f9-cdb4-4068-94be-ee113499ac1b tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210" status: 404 len: 111 microversion: 2.1 time: 0.026525 Oct 12 04:19:54.855727 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 287/565] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:54 2021] GET /compute/v2.1/servers/ce6b1d1f-abeb-4ab7-a402-c003f0171210 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:19:54.942233 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-c334c40b-6db3-48d0-9a66-4b0b93ea6243 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:54.942879 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-c334c40b-6db3-48d0-9a66-4b0b93ea6243 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:54.949028 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c334c40b-6db3-48d0-9a66-4b0b93ea6243 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:54.949482 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c334c40b-6db3-48d0-9a66-4b0b93ea6243 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:54.950261 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c334c40b-6db3-48d0-9a66-4b0b93ea6243 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:54.950725 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c334c40b-6db3-48d0-9a66-4b0b93ea6243 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:55.073352 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c334c40b-6db3-48d0-9a66-4b0b93ea6243 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:55.078878 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c334c40b-6db3-48d0-9a66-4b0b93ea6243 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:55.080408 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c334c40b-6db3-48d0-9a66-4b0b93ea6243 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:55.081626 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-c334c40b-6db3-48d0-9a66-4b0b93ea6243 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1807 microversion: 2.20 time: 0.143080 Oct 12 04:19:55.082225 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 279/566] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:54 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1807 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:55.642284 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-e6a316df-06b5-4b0f-a779-85466541858b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:55.642916 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-e6a316df-06b5-4b0f-a779-85466541858b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:55.649285 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e6a316df-06b5-4b0f-a779-85466541858b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:55.649723 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e6a316df-06b5-4b0f-a779-85466541858b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:55.650469 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e6a316df-06b5-4b0f-a779-85466541858b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:55.650920 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e6a316df-06b5-4b0f-a779-85466541858b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:55.775679 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-e6a316df-06b5-4b0f-a779-85466541858b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:55.783351 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-e6a316df-06b5-4b0f-a779-85466541858b tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1555 microversion: 2.1 time: 0.144706 Oct 12 04:19:55.783898 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 288/567] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:55 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1555 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:56.099290 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-f2f2330b-094f-4d47-9156-59e4875a617b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:56.099784 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ed176c22-f2ad-4097-96c6-7653b754b85d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:56.100157 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-f2f2330b-094f-4d47-9156-59e4875a617b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:56.100260 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ed176c22-f2ad-4097-96c6-7653b754b85d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:56.105568 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f2f2330b-094f-4d47-9156-59e4875a617b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:56.105697 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ed176c22-f2ad-4097-96c6-7653b754b85d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:56.106008 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f2f2330b-094f-4d47-9156-59e4875a617b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:56.106118 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ed176c22-f2ad-4097-96c6-7653b754b85d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:56.106795 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f2f2330b-094f-4d47-9156-59e4875a617b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:56.106894 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ed176c22-f2ad-4097-96c6-7653b754b85d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:56.107221 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f2f2330b-094f-4d47-9156-59e4875a617b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:56.107315 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ed176c22-f2ad-4097-96c6-7653b754b85d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:56.131546 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ed176c22-f2ad-4097-96c6-7653b754b85d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Going to try to terminate instance {{(pid=108897) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 04:19:56.230007 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-f2f2330b-094f-4d47-9156-59e4875a617b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:56.238345 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-f2f2330b-094f-4d47-9156-59e4875a617b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:56.239912 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-f2f2330b-094f-4d47-9156-59e4875a617b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:56.241056 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-f2f2330b-094f-4d47-9156-59e4875a617b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1807 microversion: 2.20 time: 0.145357 Oct 12 04:19:56.242120 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 280/568] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:56 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1807 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:56.402306 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ed176c22-f2ad-4097-96c6-7653b754b85d tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "DELETE /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa" status: 204 len: 0 microversion: 2.1 time: 0.306121 Oct 12 04:19:56.402847 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 289/569] 10.222.0.21 () {58 vars in 1238 bytes} [Tue Oct 12 04:19:56 2021] DELETE /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 04:19:56.410402 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-00ed32e7-5b87-4672-a7d4-2eb42f721654 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:56.411121 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-00ed32e7-5b87-4672-a7d4-2eb42f721654 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:56.417320 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-00ed32e7-5b87-4672-a7d4-2eb42f721654 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:56.417769 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-00ed32e7-5b87-4672-a7d4-2eb42f721654 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:56.418623 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-00ed32e7-5b87-4672-a7d4-2eb42f721654 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:56.419092 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-00ed32e7-5b87-4672-a7d4-2eb42f721654 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:56.544471 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-00ed32e7-5b87-4672-a7d4-2eb42f721654 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:56.551555 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-00ed32e7-5b87-4672-a7d4-2eb42f721654 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa" status: 200 len: 1513 microversion: 2.1 time: 0.144721 Oct 12 04:19:56.552110 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 281/570] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:56 2021] GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa => generated 1513 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:56.800985 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-8e40f557-817c-490b-85f9-9139d803f0b9 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:56.801701 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-8e40f557-817c-490b-85f9-9139d803f0b9 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:56.808144 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8e40f557-817c-490b-85f9-9139d803f0b9 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:56.808593 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8e40f557-817c-490b-85f9-9139d803f0b9 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:56.809358 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8e40f557-817c-490b-85f9-9139d803f0b9 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:56.809792 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8e40f557-817c-490b-85f9-9139d803f0b9 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:56.933198 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-8e40f557-817c-490b-85f9-9139d803f0b9 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:56.940928 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-8e40f557-817c-490b-85f9-9139d803f0b9 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1561 microversion: 2.1 time: 0.144115 Oct 12 04:19:56.941494 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 290/571] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:56 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1561 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:57.006238 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-7a9e59e4-56b6-49bf-8f3b-de327a536246 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:57.006854 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-7a9e59e4-56b6-49bf-8f3b-de327a536246 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:57.013532 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7a9e59e4-56b6-49bf-8f3b-de327a536246 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:57.013923 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7a9e59e4-56b6-49bf-8f3b-de327a536246 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:57.014701 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7a9e59e4-56b6-49bf-8f3b-de327a536246 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:57.015131 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7a9e59e4-56b6-49bf-8f3b-de327a536246 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:57.090891 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.objects.instance [None req-7a9e59e4-56b6-49bf-8f3b-de327a536246 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lazy-loading 'services' on Instance uuid d927fdb5-40b1-4279-9f0c-7006831e05d2 {{(pid=108898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:19:57.236967 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-7a9e59e4-56b6-49bf-8f3b-de327a536246 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "DELETE /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2/os-volume_attachments/20bbc5f8-5aa7-493a-8d35-95a441725c6c" status: 202 len: 0 microversion: 2.1 time: 0.234774 Oct 12 04:19:57.241888 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 282/572] 10.222.0.21 () {58 vars in 1415 bytes} [Tue Oct 12 04:19:57 2021] DELETE /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2/os-volume_attachments/20bbc5f8-5aa7-493a-8d35-95a441725c6c => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:19:57.246012 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-718c19fd-4c31-4f7b-bd10-8103748c9260 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:57.247103 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-718c19fd-4c31-4f7b-bd10-8103748c9260 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:57.254157 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-718c19fd-4c31-4f7b-bd10-8103748c9260 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:57.263021 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-718c19fd-4c31-4f7b-bd10-8103748c9260 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:57.263021 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-718c19fd-4c31-4f7b-bd10-8103748c9260 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:57.263021 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-718c19fd-4c31-4f7b-bd10-8103748c9260 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:57.263404 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-a7bb9850-6dbc-4fb5-b7ed-276c11e850dc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:57.263404 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-a7bb9850-6dbc-4fb5-b7ed-276c11e850dc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:57.267677 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a7bb9850-6dbc-4fb5-b7ed-276c11e850dc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:57.268061 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a7bb9850-6dbc-4fb5-b7ed-276c11e850dc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:57.268832 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a7bb9850-6dbc-4fb5-b7ed-276c11e850dc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:57.269468 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a7bb9850-6dbc-4fb5-b7ed-276c11e850dc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:57.288689 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-718c19fd-4c31-4f7b-bd10-8103748c9260 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046657 Oct 12 04:19:57.289252 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 291/573] 10.222.0.21 () {58 vars in 1301 bytes} [Tue Oct 12 04:19:57 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:19:57.394442 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-a7bb9850-6dbc-4fb5-b7ed-276c11e850dc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:57.403612 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-a7bb9850-6dbc-4fb5-b7ed-276c11e850dc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:57.405097 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-a7bb9850-6dbc-4fb5-b7ed-276c11e850dc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:57.406246 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-a7bb9850-6dbc-4fb5-b7ed-276c11e850dc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1807 microversion: 2.20 time: 0.150591 Oct 12 04:19:57.410715 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 283/574] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:57 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:57.568800 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-bbe34283-73a7-415a-9c0e-f17212e633a3 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:57.569407 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-bbe34283-73a7-415a-9c0e-f17212e633a3 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:57.575651 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bbe34283-73a7-415a-9c0e-f17212e633a3 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:57.576100 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bbe34283-73a7-415a-9c0e-f17212e633a3 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:57.576851 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bbe34283-73a7-415a-9c0e-f17212e633a3 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:57.577279 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bbe34283-73a7-415a-9c0e-f17212e633a3 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:57.691412 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-bbe34283-73a7-415a-9c0e-f17212e633a3 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:57.700393 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-bbe34283-73a7-415a-9c0e-f17212e633a3 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa" status: 200 len: 1513 microversion: 2.1 time: 0.135186 Oct 12 04:19:57.700952 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 292/575] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:57 2021] GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa => generated 1513 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:58.300782 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-21c6a89d-8cb0-444c-b774-45585f12545c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:58.302120 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-21c6a89d-8cb0-444c-b774-45585f12545c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:58.309819 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-21c6a89d-8cb0-444c-b774-45585f12545c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:58.309819 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-21c6a89d-8cb0-444c-b774-45585f12545c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:58.310288 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-21c6a89d-8cb0-444c-b774-45585f12545c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:58.310737 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-21c6a89d-8cb0-444c-b774-45585f12545c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:58.351930 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-21c6a89d-8cb0-444c-b774-45585f12545c tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054788 Oct 12 04:19:58.353210 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 284/576] 10.222.0.21 () {58 vars in 1301 bytes} [Tue Oct 12 04:19:58 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:19:58.460948 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-7ddf00fb-a3f2-404d-9b1d-c51cb4ed5635 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:58.461573 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-7ddf00fb-a3f2-404d-9b1d-c51cb4ed5635 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:58.467397 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7ddf00fb-a3f2-404d-9b1d-c51cb4ed5635 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:58.467944 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7ddf00fb-a3f2-404d-9b1d-c51cb4ed5635 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:58.468710 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7ddf00fb-a3f2-404d-9b1d-c51cb4ed5635 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:58.469150 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7ddf00fb-a3f2-404d-9b1d-c51cb4ed5635 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:58.627738 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-7ddf00fb-a3f2-404d-9b1d-c51cb4ed5635 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:58.635694 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-7ddf00fb-a3f2-404d-9b1d-c51cb4ed5635 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:58.637163 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-7ddf00fb-a3f2-404d-9b1d-c51cb4ed5635 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:58.638286 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-7ddf00fb-a3f2-404d-9b1d-c51cb4ed5635 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1807 microversion: 2.20 time: 0.181096 Oct 12 04:19:58.638856 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 293/577] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:58 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:19:58.717538 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-67b9071d-13c9-4490-8020-26b0299c36f5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:58.718137 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-67b9071d-13c9-4490-8020-26b0299c36f5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:58.723865 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-67b9071d-13c9-4490-8020-26b0299c36f5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:58.724301 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-67b9071d-13c9-4490-8020-26b0299c36f5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:58.725053 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-67b9071d-13c9-4490-8020-26b0299c36f5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:58.725476 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-67b9071d-13c9-4490-8020-26b0299c36f5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:58.750963 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-79e3ef4c-d35a-4ac8-b7bd-9646d589b14b req-750421cf-1987-4d30-b9a7-000d6db753d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "494a399f-a68d-4e9f-8259-fbe4f5b830fa", "name": "network-vif-deleted", "tag": "e338ea68-ade7-4184-bc31-d3b708620700"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:19:58.753136 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:19:58.753136 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:19:58.760263 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-79e3ef4c-d35a-4ac8-b7bd-9646d589b14b req-750421cf-1987-4d30-b9a7-000d6db753d1 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:58.760827 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-79e3ef4c-d35a-4ac8-b7bd-9646d589b14b req-750421cf-1987-4d30-b9a7-000d6db753d1 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:58.773012 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-79e3ef4c-d35a-4ac8-b7bd-9646d589b14b req-750421cf-1987-4d30-b9a7-000d6db753d1 service nova] Creating event network-vif-deleted:e338ea68-ade7-4184-bc31-d3b708620700 for instance 494a399f-a68d-4e9f-8259-fbe4f5b830fa on hv-cinder-81306 Oct 12 04:19:58.778496 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-79e3ef4c-d35a-4ac8-b7bd-9646d589b14b req-750421cf-1987-4d30-b9a7-000d6db753d1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031398 Oct 12 04:19:58.779178 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 294/578] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:19:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:19:58.792786 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-67b9071d-13c9-4490-8020-26b0299c36f5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56a34c8635a4d3385b0dc3f40f469bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e19031226d475dbcf3cdfa50550ef4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:58.800472 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-67b9071d-13c9-4490-8020-26b0299c36f5 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa" status: 200 len: 1471 microversion: 2.1 time: 0.086568 Oct 12 04:19:58.801031 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 285/579] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:58 2021] GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa => generated 1471 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:19:59.364702 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-deb91214-0862-42ea-af8e-b29c7ec572ae tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:59.365687 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-deb91214-0862-42ea-af8e-b29c7ec572ae tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:59.372018 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-deb91214-0862-42ea-af8e-b29c7ec572ae tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:59.372457 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-deb91214-0862-42ea-af8e-b29c7ec572ae tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:59.373273 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-deb91214-0862-42ea-af8e-b29c7ec572ae tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:59.373703 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-deb91214-0862-42ea-af8e-b29c7ec572ae tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:59.388614 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-1a57273a-6aed-4719-b4fd-818fb11a3434 req-eb62d434-10b9-401b-82b8-f499c4139eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29fcfae4-9349-4167-9403-9a4a20f346bd", "name": "network-vif-plugged", "status": "completed", "tag": "c5a9a497-7d69-4ed5-85cb-fa9a1cc1b4bf"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:19:59.395288 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:19:59.395288 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:19:59.402228 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-1a57273a-6aed-4719-b4fd-818fb11a3434 req-eb62d434-10b9-401b-82b8-f499c4139eae service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:59.402696 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-1a57273a-6aed-4719-b4fd-818fb11a3434 req-eb62d434-10b9-401b-82b8-f499c4139eae service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:59.405345 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-deb91214-0862-42ea-af8e-b29c7ec572ae tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044682 Oct 12 04:19:59.406201 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 295/580] 10.222.0.21 () {58 vars in 1301 bytes} [Tue Oct 12 04:19:59 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 04:19:59.414190 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-1a57273a-6aed-4719-b4fd-818fb11a3434 req-eb62d434-10b9-401b-82b8-f499c4139eae service nova] Creating event network-vif-plugged:c5a9a497-7d69-4ed5-85cb-fa9a1cc1b4bf for instance 29fcfae4-9349-4167-9403-9a4a20f346bd on hv-cinder-81306 Oct 12 04:19:59.418893 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-1a57273a-6aed-4719-b4fd-818fb11a3434 req-eb62d434-10b9-401b-82b8-f499c4139eae service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034741 Oct 12 04:19:59.419482 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 286/581] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:19:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:19:59.655647 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-b3036c32-cc75-4871-8f76-3a9211460f61 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:59.656398 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-b3036c32-cc75-4871-8f76-3a9211460f61 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:59.661982 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b3036c32-cc75-4871-8f76-3a9211460f61 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:59.662419 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b3036c32-cc75-4871-8f76-3a9211460f61 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:59.663203 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b3036c32-cc75-4871-8f76-3a9211460f61 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:59.663653 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b3036c32-cc75-4871-8f76-3a9211460f61 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:59.819927 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-2182151a-9a65-4f31-8b48-123c4ff19db1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:19:59.820626 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-2182151a-9a65-4f31-8b48-123c4ff19db1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] [instance: 494a399f-a68d-4e9f-8259-fbe4f5b830fa] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:19:59.826565 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2182151a-9a65-4f31-8b48-123c4ff19db1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:59.828155 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2182151a-9a65-4f31-8b48-123c4ff19db1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:59.828932 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2182151a-9a65-4f31-8b48-123c4ff19db1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:19:59.829368 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2182151a-9a65-4f31-8b48-123c4ff19db1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:19:59.842492 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.wsgi [None req-2182151a-9a65-4f31-8b48-123c4ff19db1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] HTTP exception thrown: Instance 494a399f-a68d-4e9f-8259-fbe4f5b830fa could not be found. Oct 12 04:19:59.843154 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-2182151a-9a65-4f31-8b48-123c4ff19db1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] Returning 404 to user: Instance 494a399f-a68d-4e9f-8259-fbe4f5b830fa could not be found. {{(pid=108898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:19:59.844002 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-2182151a-9a65-4f31-8b48-123c4ff19db1 tempest-AttachVolumeNegativeTest-2018097516 tempest-AttachVolumeNegativeTest-2018097516-project] 10.222.0.21 "GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa" status: 404 len: 111 microversion: 2.1 time: 0.028251 Oct 12 04:19:59.844750 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 287/582] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:19:59 2021] GET /compute/v2.1/servers/494a399f-a68d-4e9f-8259-fbe4f5b830fa => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 04:19:59.899134 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-b3036c32-cc75-4871-8f76-3a9211460f61 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:59.907711 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-b3036c32-cc75-4871-8f76-3a9211460f61 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:59.909222 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-b3036c32-cc75-4871-8f76-3a9211460f61 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:19:59.910625 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-b3036c32-cc75-4871-8f76-3a9211460f61 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1807 microversion: 2.20 time: 0.258809 Oct 12 04:19:59.921818 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 296/583] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:19:59 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1807 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:20:00.928999 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-e43d9c99-99fd-4c8a-b619-7e2d34edb5de tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:00.929610 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-e43d9c99-99fd-4c8a-b619-7e2d34edb5de tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:00.937400 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e43d9c99-99fd-4c8a-b619-7e2d34edb5de tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:00.937849 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e43d9c99-99fd-4c8a-b619-7e2d34edb5de tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:00.938625 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e43d9c99-99fd-4c8a-b619-7e2d34edb5de tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:00.939349 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e43d9c99-99fd-4c8a-b619-7e2d34edb5de tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:01.084036 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-e43d9c99-99fd-4c8a-b619-7e2d34edb5de tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:01.092607 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-e43d9c99-99fd-4c8a-b619-7e2d34edb5de tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:01.096433 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-e43d9c99-99fd-4c8a-b619-7e2d34edb5de tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:01.097600 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-e43d9c99-99fd-4c8a-b619-7e2d34edb5de tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1807 microversion: 2.20 time: 0.172315 Oct 12 04:20:01.098221 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 288/584] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:20:00 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:20:02.009067 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-2e95bf43-7f20-47f4-8eba-8f7b7bab7fdd tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:02.009642 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-2e95bf43-7f20-47f4-8eba-8f7b7bab7fdd tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:02.015401 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2e95bf43-7f20-47f4-8eba-8f7b7bab7fdd tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:02.015844 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2e95bf43-7f20-47f4-8eba-8f7b7bab7fdd tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:02.016606 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2e95bf43-7f20-47f4-8eba-8f7b7bab7fdd tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:02.017034 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2e95bf43-7f20-47f4-8eba-8f7b7bab7fdd tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:02.044251 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-2e95bf43-7f20-47f4-8eba-8f7b7bab7fdd tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Going to try to terminate instance {{(pid=108897) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 04:20:02.165004 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-aa17b51a-1cec-4506-ac4d-09e7a4a330f0 tempest-VolumesNegativeTest-258955881 tempest-VolumesNegativeTest-258955881-project] Action: 'create', calling method: .version_select at 0x7f385591d700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-948939763", "metadata": {"Type": "work"}}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:20:02.166538 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-aa17b51a-1cec-4506-ac4d-09e7a4a330f0 tempest-VolumesNegativeTest-258955881 tempest-VolumesNegativeTest-258955881-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=108898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:20:02.167488 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-aa17b51a-1cec-4506-ac4d-09e7a4a330f0 tempest-VolumesNegativeTest-258955881 tempest-VolumesNegativeTest-258955881-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.140265 Oct 12 04:20:02.168089 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 289/585] 10.222.0.21 () {60 vars in 1155 bytes} [Tue Oct 12 04:20:02 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 12 04:20:02.172605 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d670541b-831b-46e8-8b84-03e6ef34781c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:02.174119 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-d670541b-831b-46e8-8b84-03e6ef34781c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:02.181297 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d670541b-831b-46e8-8b84-03e6ef34781c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:02.182169 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d670541b-831b-46e8-8b84-03e6ef34781c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:02.183091 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d670541b-831b-46e8-8b84-03e6ef34781c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:02.183602 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d670541b-831b-46e8-8b84-03e6ef34781c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:02.305175 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-d670541b-831b-46e8-8b84-03e6ef34781c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:02.313321 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-d670541b-831b-46e8-8b84-03e6ef34781c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:02.314826 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-d670541b-831b-46e8-8b84-03e6ef34781c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:02.315995 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-d670541b-831b-46e8-8b84-03e6ef34781c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1807 microversion: 2.20 time: 0.146785 Oct 12 04:20:02.316526 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 290/586] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:20:02 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1807 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:20:02.320628 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-52ebeffa-7caa-46fc-af5a-88bb8c578156 tempest-VolumesNegativeTest-258955881 tempest-VolumesNegativeTest-258955881-project] Action: 'create', calling method: .version_select at 0x7f38555ead30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2105131332", "metadata": {"Type": "work"}}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:20:02.322285 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-52ebeffa-7caa-46fc-af5a-88bb8c578156 tempest-VolumesNegativeTest-258955881 tempest-VolumesNegativeTest-258955881-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=108898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:20:02.323079 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-52ebeffa-7caa-46fc-af5a-88bb8c578156 tempest-VolumesNegativeTest-258955881 tempest-VolumesNegativeTest-258955881-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.005638 Oct 12 04:20:02.323565 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 291/587] 10.222.0.21 () {60 vars in 1155 bytes} [Tue Oct 12 04:20:02 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 6 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 04:20:02.331902 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d82e6ee8-d5d0-447f-9456-a62f3cfee148 tempest-VolumesNegativeTest-258955881 tempest-VolumesNegativeTest-258955881-project] Action: 'create', calling method: .version_select at 0x7f3855636550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1848104693", "metadata": {"Type": "work"}}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:20:02.333028 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d82e6ee8-d5d0-447f-9456-a62f3cfee148 tempest-VolumesNegativeTest-258955881 tempest-VolumesNegativeTest-258955881-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=108898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:20:02.333851 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-d82e6ee8-d5d0-447f-9456-a62f3cfee148 tempest-VolumesNegativeTest-258955881 tempest-VolumesNegativeTest-258955881-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005287 Oct 12 04:20:02.334332 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 292/588] 10.222.0.21 () {60 vars in 1155 bytes} [Tue Oct 12 04:20:02 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 6 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 12 04:20:02.343107 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-9b0bc7ba-8a31-438d-b4c9-d559b223af82 tempest-VolumesNegativeTest-258955881 tempest-VolumesNegativeTest-258955881-project] Calling method '.version_select at 0x7f38556a2c10>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:02.371202 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.wsgi [None req-9b0bc7ba-8a31-438d-b4c9-d559b223af82 tempest-VolumesNegativeTest-258955881 tempest-VolumesNegativeTest-258955881-project] HTTP exception thrown: Volume tempest-invalid-1606620242 could not be found. Oct 12 04:20:02.372025 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-9b0bc7ba-8a31-438d-b4c9-d559b223af82 tempest-VolumesNegativeTest-258955881 tempest-VolumesNegativeTest-258955881-project] Returning 404 to user: Volume tempest-invalid-1606620242 could not be found. {{(pid=108898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:20:02.372752 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-9b0bc7ba-8a31-438d-b4c9-d559b223af82 tempest-VolumesNegativeTest-258955881 tempest-VolumesNegativeTest-258955881-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1606620242" status: 404 len: 99 microversion: 2.1 time: 0.033350 Oct 12 04:20:02.373177 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 293/589] 10.222.0.21 () {58 vars in 1217 bytes} [Tue Oct 12 04:20:02 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1606620242 => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 12 04:20:02.380824 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-2e95bf43-7f20-47f4-8eba-8f7b7bab7fdd tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "DELETE /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 204 len: 0 microversion: 2.1 time: 0.375752 Oct 12 04:20:02.381645 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 297/590] 10.222.0.21 () {58 vars in 1238 bytes} [Tue Oct 12 04:20:02 2021] DELETE /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 04:20:02.382377 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-29272704-bd91-4a18-8bf8-bce395760f59 tempest-VolumesNegativeTest-258955881 tempest-VolumesNegativeTest-258955881-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003484 Oct 12 04:20:02.389553 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 294/591] 10.222.0.21 () {58 vars in 1139 bytes} [Tue Oct 12 04:20:02 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 12 04:20:02.398234 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-251587bf-c98c-4d97-922a-9ab5c1d5792e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:02.398434 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-b1611584-ae01-44ce-bb40-8a9f67cafd0e tempest-VolumesNegativeTest-258955881 tempest-VolumesNegativeTest-258955881-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003500 Oct 12 04:20:02.398891 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 295/592] 10.222.0.21 () {58 vars in 1136 bytes} [Tue Oct 12 04:20:02 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 12 04:20:02.399036 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-251587bf-c98c-4d97-922a-9ab5c1d5792e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:02.404915 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-251587bf-c98c-4d97-922a-9ab5c1d5792e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:02.405359 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-251587bf-c98c-4d97-922a-9ab5c1d5792e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:02.406123 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-251587bf-c98c-4d97-922a-9ab5c1d5792e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:02.406551 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-251587bf-c98c-4d97-922a-9ab5c1d5792e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:02.406687 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-5d88de94-b5e5-4da5-b4c6-873e765fd046 tempest-VolumesNegativeTest-258955881 tempest-VolumesNegativeTest-258955881-project] Calling method '.version_select at 0x7f3855639550>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:02.433062 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.wsgi [None req-5d88de94-b5e5-4da5-b4c6-873e765fd046 tempest-VolumesNegativeTest-258955881 tempest-VolumesNegativeTest-258955881-project] HTTP exception thrown: Volume 5cb232d6-a23e-40e8-95f4-514138ebb2d1 could not be found. Oct 12 04:20:02.433651 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-5d88de94-b5e5-4da5-b4c6-873e765fd046 tempest-VolumesNegativeTest-258955881 tempest-VolumesNegativeTest-258955881-project] Returning 404 to user: Volume 5cb232d6-a23e-40e8-95f4-514138ebb2d1 could not be found. {{(pid=108898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:20:02.434840 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-5d88de94-b5e5-4da5-b4c6-873e765fd046 tempest-VolumesNegativeTest-258955881 tempest-VolumesNegativeTest-258955881-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/5cb232d6-a23e-40e8-95f4-514138ebb2d1" status: 404 len: 109 microversion: 2.1 time: 0.031364 Oct 12 04:20:02.435520 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 296/593] 10.222.0.21 () {58 vars in 1247 bytes} [Tue Oct 12 04:20:02 2021] DELETE /compute/v2.1/os-volumes/5cb232d6-a23e-40e8-95f4-514138ebb2d1 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 04:20:02.444559 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-fbf34f28-e397-427a-99d1-5672c80dc1f3 tempest-VolumesNegativeTest-258955881 tempest-VolumesNegativeTest-258955881-project] Calling method '.version_select at 0x7f38558e6700>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:02.472065 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.wsgi [None req-fbf34f28-e397-427a-99d1-5672c80dc1f3 tempest-VolumesNegativeTest-258955881 tempest-VolumesNegativeTest-258955881-project] HTTP exception thrown: Volume 8deaf623-9392-4433-91b4-303706dc0f5b could not be found. Oct 12 04:20:02.472726 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-fbf34f28-e397-427a-99d1-5672c80dc1f3 tempest-VolumesNegativeTest-258955881 tempest-VolumesNegativeTest-258955881-project] Returning 404 to user: Volume 8deaf623-9392-4433-91b4-303706dc0f5b could not be found. {{(pid=108898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:20:02.473685 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-fbf34f28-e397-427a-99d1-5672c80dc1f3 tempest-VolumesNegativeTest-258955881 tempest-VolumesNegativeTest-258955881-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/8deaf623-9392-4433-91b4-303706dc0f5b" status: 404 len: 109 microversion: 2.1 time: 0.032486 Oct 12 04:20:02.474442 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 297/594] 10.222.0.21 () {58 vars in 1244 bytes} [Tue Oct 12 04:20:02 2021] GET /compute/v2.1/os-volumes/8deaf623-9392-4433-91b4-303706dc0f5b => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 04:20:02.534034 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-251587bf-c98c-4d97-922a-9ab5c1d5792e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:02.541743 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-251587bf-c98c-4d97-922a-9ab5c1d5792e tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1508 microversion: 2.1 time: 0.148079 Oct 12 04:20:02.542312 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 298/595] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:02 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:20:03.340637 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-54293644-171b-4ed5-951c-880b66825fd0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:03.341906 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-54293644-171b-4ed5-951c-880b66825fd0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:03.348732 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-54293644-171b-4ed5-951c-880b66825fd0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:03.349233 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-54293644-171b-4ed5-951c-880b66825fd0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:03.350040 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-54293644-171b-4ed5-951c-880b66825fd0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:03.350582 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-54293644-171b-4ed5-951c-880b66825fd0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:03.470899 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-54293644-171b-4ed5-951c-880b66825fd0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:03.479577 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-54293644-171b-4ed5-951c-880b66825fd0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:03.481137 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-54293644-171b-4ed5-951c-880b66825fd0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:03.482289 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-54293644-171b-4ed5-951c-880b66825fd0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1794 microversion: 2.20 time: 0.150988 Oct 12 04:20:03.483345 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 298/596] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:20:03 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1794 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:20:03.558357 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-28692bd4-46b7-425e-b9c6-257b24db1967 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:03.558991 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-28692bd4-46b7-425e-b9c6-257b24db1967 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:03.564727 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-28692bd4-46b7-425e-b9c6-257b24db1967 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:03.565168 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-28692bd4-46b7-425e-b9c6-257b24db1967 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:03.565923 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-28692bd4-46b7-425e-b9c6-257b24db1967 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:03.566351 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-28692bd4-46b7-425e-b9c6-257b24db1967 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:03.691977 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-28692bd4-46b7-425e-b9c6-257b24db1967 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:03.699828 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-28692bd4-46b7-425e-b9c6-257b24db1967 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1508 microversion: 2.1 time: 0.145081 Oct 12 04:20:03.700579 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 299/597] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:03 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1508 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:20:04.717103 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-9dd9e5d3-1261-4e95-a587-bb58e25d4e45 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:04.717630 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-9dd9e5d3-1261-4e95-a587-bb58e25d4e45 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:04.723400 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9dd9e5d3-1261-4e95-a587-bb58e25d4e45 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:04.723845 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9dd9e5d3-1261-4e95-a587-bb58e25d4e45 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:04.724611 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9dd9e5d3-1261-4e95-a587-bb58e25d4e45 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:04.725037 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9dd9e5d3-1261-4e95-a587-bb58e25d4e45 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:04.850544 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-9dd9e5d3-1261-4e95-a587-bb58e25d4e45 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:04.859224 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-9dd9e5d3-1261-4e95-a587-bb58e25d4e45 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1508 microversion: 2.1 time: 0.145781 Oct 12 04:20:04.859985 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 299/598] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:04 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:20:05.392038 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-3c8852ed-2e22-4325-b181-e50d964f4546 req-21314cdf-5c7f-4de2-9657-1de98b9abd50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92d84886-10fd-4ae9-a6fa-6c0a75409709", "name": "network-vif-deleted", "tag": "daa88131-1b96-4370-98b3-d5a9a75dda98"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:20:05.393601 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:20:05.393601 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:20:05.401345 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-3c8852ed-2e22-4325-b181-e50d964f4546 req-21314cdf-5c7f-4de2-9657-1de98b9abd50 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:05.401778 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-3c8852ed-2e22-4325-b181-e50d964f4546 req-21314cdf-5c7f-4de2-9657-1de98b9abd50 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:05.413228 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-3c8852ed-2e22-4325-b181-e50d964f4546 req-21314cdf-5c7f-4de2-9657-1de98b9abd50 service nova] Creating event network-vif-deleted:daa88131-1b96-4370-98b3-d5a9a75dda98 for instance 92d84886-10fd-4ae9-a6fa-6c0a75409709 on hv-cinder-81306 Oct 12 04:20:05.418960 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-3c8852ed-2e22-4325-b181-e50d964f4546 req-21314cdf-5c7f-4de2-9657-1de98b9abd50 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030809 Oct 12 04:20:05.419534 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 300/599] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:20:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:20:05.876098 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d150c831-14c4-4c3c-8488-5121348df52d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:05.876098 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-d150c831-14c4-4c3c-8488-5121348df52d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:05.882067 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d150c831-14c4-4c3c-8488-5121348df52d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:05.882618 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d150c831-14c4-4c3c-8488-5121348df52d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:05.883534 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d150c831-14c4-4c3c-8488-5121348df52d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:05.884060 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d150c831-14c4-4c3c-8488-5121348df52d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:05.913220 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d150c831-14c4-4c3c-8488-5121348df52d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:05.913662 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d150c831-14c4-4c3c-8488-5121348df52d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:05.914102 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.objects.instance [None req-d150c831-14c4-4c3c-8488-5121348df52d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lazy-loading 'fault' on Instance uuid 92d84886-10fd-4ae9-a6fa-6c0a75409709 {{(pid=108898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:20:05.953915 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-d150c831-14c4-4c3c-8488-5121348df52d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:05.961697 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-d150c831-14c4-4c3c-8488-5121348df52d tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 200 len: 1312 microversion: 2.1 time: 0.089671 Oct 12 04:20:05.962264 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 300/600] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:05 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 1312 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:20:06.325125 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-cdaaa20a-55ee-426b-a3a6-e1720e443714 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:06.325715 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-cdaaa20a-55ee-426b-a3a6-e1720e443714 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:06.331732 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-cdaaa20a-55ee-426b-a3a6-e1720e443714 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:06.332172 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-cdaaa20a-55ee-426b-a3a6-e1720e443714 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:06.333042 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-cdaaa20a-55ee-426b-a3a6-e1720e443714 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:06.333470 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-cdaaa20a-55ee-426b-a3a6-e1720e443714 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:06.412170 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.objects.instance [None req-cdaaa20a-55ee-426b-a3a6-e1720e443714 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lazy-loading 'services' on Instance uuid bbee8a27-52f2-42c0-8cb5-bfade5bfb587 {{(pid=108897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:20:06.624960 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-cdaaa20a-55ee-426b-a3a6-e1720e443714 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "DELETE /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/os-volume_attachments/a230c685-abb4-405f-8c09-859c6f89f3e0" status: 202 len: 0 microversion: 2.1 time: 0.303831 Oct 12 04:20:06.625555 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 301/601] 10.222.0.21 () {58 vars in 1415 bytes} [Tue Oct 12 04:20:06 2021] DELETE /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/os-volume_attachments/a230c685-abb4-405f-8c09-859c6f89f3e0 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:20:06.983400 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-7bb4244f-10e0-4572-b5c1-34e6e4e2ce52 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:06.984000 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-7bb4244f-10e0-4572-b5c1-34e6e4e2ce52 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: 92d84886-10fd-4ae9-a6fa-6c0a75409709] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:06.989815 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7bb4244f-10e0-4572-b5c1-34e6e4e2ce52 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:06.990254 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7bb4244f-10e0-4572-b5c1-34e6e4e2ce52 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:06.991032 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7bb4244f-10e0-4572-b5c1-34e6e4e2ce52 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:06.991457 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7bb4244f-10e0-4572-b5c1-34e6e4e2ce52 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:07.005373 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.wsgi [None req-7bb4244f-10e0-4572-b5c1-34e6e4e2ce52 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] HTTP exception thrown: Instance 92d84886-10fd-4ae9-a6fa-6c0a75409709 could not be found. Oct 12 04:20:07.006320 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-7bb4244f-10e0-4572-b5c1-34e6e4e2ce52 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Returning 404 to user: Instance 92d84886-10fd-4ae9-a6fa-6c0a75409709 could not be found. {{(pid=108898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:20:07.006921 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-7bb4244f-10e0-4572-b5c1-34e6e4e2ce52 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709" status: 404 len: 111 microversion: 2.1 time: 0.027683 Oct 12 04:20:07.007623 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 301/602] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:06 2021] GET /compute/v2.1/servers/92d84886-10fd-4ae9-a6fa-6c0a75409709 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:20:07.016437 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-9f72ec0c-3918-4aff-9a6b-6f80cfec9b49 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:07.017092 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-9f72ec0c-3918-4aff-9a6b-6f80cfec9b49 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:07.023069 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9f72ec0c-3918-4aff-9a6b-6f80cfec9b49 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:07.023614 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9f72ec0c-3918-4aff-9a6b-6f80cfec9b49 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:07.024381 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9f72ec0c-3918-4aff-9a6b-6f80cfec9b49 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:07.024812 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9f72ec0c-3918-4aff-9a6b-6f80cfec9b49 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:07.049101 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-9f72ec0c-3918-4aff-9a6b-6f80cfec9b49 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Going to try to terminate instance {{(pid=108897) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 04:20:07.426206 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-9f72ec0c-3918-4aff-9a6b-6f80cfec9b49 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "DELETE /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 204 len: 0 microversion: 2.1 time: 0.413466 Oct 12 04:20:07.426885 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 302/603] 10.222.0.21 () {58 vars in 1238 bytes} [Tue Oct 12 04:20:07 2021] DELETE /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 04:20:07.435310 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d91ed101-9bff-450a-ae2c-f7cd874bd843 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:07.436161 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-d91ed101-9bff-450a-ae2c-f7cd874bd843 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:07.441819 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d91ed101-9bff-450a-ae2c-f7cd874bd843 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:07.442255 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d91ed101-9bff-450a-ae2c-f7cd874bd843 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:07.443038 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d91ed101-9bff-450a-ae2c-f7cd874bd843 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:07.443463 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d91ed101-9bff-450a-ae2c-f7cd874bd843 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:07.740199 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-5b09385f-085b-490d-b8a0-1e1641b853a2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:20:07.746841 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5b09385f-085b-490d-b8a0-1e1641b853a2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:07.747509 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5b09385f-085b-490d-b8a0-1e1641b853a2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:07.769407 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-5b09385f-085b-490d-b8a0-1e1641b853a2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Going to try to stop instance {{(pid=108897) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 12 04:20:07.804553 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-d91ed101-9bff-450a-ae2c-f7cd874bd843 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:07.811839 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-d91ed101-9bff-450a-ae2c-f7cd874bd843 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1521 microversion: 2.1 time: 0.380898 Oct 12 04:20:07.812406 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 302/604] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:07 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:20:08.005236 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-5b09385f-085b-490d-b8a0-1e1641b853a2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 202 len: 0 microversion: 2.1 time: 0.276798 Oct 12 04:20:08.005824 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 303/605] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:20:07 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 04:20:08.020662 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-2f118b05-d5f7-498d-9da1-110e8617f753 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:08.021264 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-2f118b05-d5f7-498d-9da1-110e8617f753 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:08.027961 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2f118b05-d5f7-498d-9da1-110e8617f753 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:08.028493 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2f118b05-d5f7-498d-9da1-110e8617f753 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:08.029244 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2f118b05-d5f7-498d-9da1-110e8617f753 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:08.029671 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2f118b05-d5f7-498d-9da1-110e8617f753 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:08.146434 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-2f118b05-d5f7-498d-9da1-110e8617f753 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:08.154464 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-2f118b05-d5f7-498d-9da1-110e8617f753 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1674 microversion: 2.1 time: 0.137422 Oct 12 04:20:08.155058 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 303/606] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:08 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1674 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:20:08.829336 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-2408ad84-d66c-43d5-b789-aef40adcaa3a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:08.830005 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-2408ad84-d66c-43d5-b789-aef40adcaa3a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:08.835905 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2408ad84-d66c-43d5-b789-aef40adcaa3a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:08.836343 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2408ad84-d66c-43d5-b789-aef40adcaa3a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:08.837091 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2408ad84-d66c-43d5-b789-aef40adcaa3a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:08.837513 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2408ad84-d66c-43d5-b789-aef40adcaa3a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:08.965888 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-2408ad84-d66c-43d5-b789-aef40adcaa3a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:08.973575 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-2408ad84-d66c-43d5-b789-aef40adcaa3a tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1521 microversion: 2.1 time: 0.148311 Oct 12 04:20:08.974213 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 304/607] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:08 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:20:09.172458 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-31c62f9c-1285-4c88-9089-3fad8172bee6 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:09.173070 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-31c62f9c-1285-4c88-9089-3fad8172bee6 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:09.178989 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-31c62f9c-1285-4c88-9089-3fad8172bee6 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:09.179440 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-31c62f9c-1285-4c88-9089-3fad8172bee6 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:09.180317 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-31c62f9c-1285-4c88-9089-3fad8172bee6 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:09.180754 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-31c62f9c-1285-4c88-9089-3fad8172bee6 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:09.306755 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-31c62f9c-1285-4c88-9089-3fad8172bee6 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:09.314338 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-31c62f9c-1285-4c88-9089-3fad8172bee6 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1674 microversion: 2.1 time: 0.145416 Oct 12 04:20:09.315025 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 304/608] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:09 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1674 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:20:09.991078 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-bc6c2148-bcc5-4b3f-8e29-4f5ea8de06e7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:09.991591 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-bc6c2148-bcc5-4b3f-8e29-4f5ea8de06e7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:09.997833 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bc6c2148-bcc5-4b3f-8e29-4f5ea8de06e7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:09.998277 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bc6c2148-bcc5-4b3f-8e29-4f5ea8de06e7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:09.999058 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bc6c2148-bcc5-4b3f-8e29-4f5ea8de06e7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:09.999490 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bc6c2148-bcc5-4b3f-8e29-4f5ea8de06e7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:10.119480 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-bc6c2148-bcc5-4b3f-8e29-4f5ea8de06e7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:10.127468 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-bc6c2148-bcc5-4b3f-8e29-4f5ea8de06e7 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1521 microversion: 2.1 time: 0.140161 Oct 12 04:20:10.128011 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 305/609] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:09 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:20:10.330938 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-520cc190-3354-41fa-964d-25cef2fbbcca tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:10.331569 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-520cc190-3354-41fa-964d-25cef2fbbcca tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:10.337387 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-520cc190-3354-41fa-964d-25cef2fbbcca tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:10.337831 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-520cc190-3354-41fa-964d-25cef2fbbcca tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:10.338591 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-520cc190-3354-41fa-964d-25cef2fbbcca tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:10.339054 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-520cc190-3354-41fa-964d-25cef2fbbcca tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:10.459169 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-520cc190-3354-41fa-964d-25cef2fbbcca tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:10.466296 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-520cc190-3354-41fa-964d-25cef2fbbcca tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1674 microversion: 2.1 time: 0.139053 Oct 12 04:20:10.466898 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 305/610] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:10 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1674 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:20:11.144367 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-f0a6e235-613c-4b57-a451-d177cfc59271 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:11.144965 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-f0a6e235-613c-4b57-a451-d177cfc59271 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:11.150592 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f0a6e235-613c-4b57-a451-d177cfc59271 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:11.151063 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f0a6e235-613c-4b57-a451-d177cfc59271 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:11.151811 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f0a6e235-613c-4b57-a451-d177cfc59271 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:11.152233 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f0a6e235-613c-4b57-a451-d177cfc59271 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:11.274196 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-f0a6e235-613c-4b57-a451-d177cfc59271 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:11.281530 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-f0a6e235-613c-4b57-a451-d177cfc59271 tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1521 microversion: 2.1 time: 0.140776 Oct 12 04:20:11.282083 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 306/611] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:11 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1521 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:20:11.483672 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-2256bac3-ae13-48a0-9cb4-ec8d84d4ac68 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:11.484303 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-2256bac3-ae13-48a0-9cb4-ec8d84d4ac68 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:11.491287 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2256bac3-ae13-48a0-9cb4-ec8d84d4ac68 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:11.492082 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2256bac3-ae13-48a0-9cb4-ec8d84d4ac68 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:11.493433 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2256bac3-ae13-48a0-9cb4-ec8d84d4ac68 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:11.494238 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2256bac3-ae13-48a0-9cb4-ec8d84d4ac68 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:11.616499 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-2256bac3-ae13-48a0-9cb4-ec8d84d4ac68 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:11.624316 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-2256bac3-ae13-48a0-9cb4-ec8d84d4ac68 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1674 microversion: 2.1 time: 0.144669 Oct 12 04:20:11.624872 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 306/612] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:11 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1674 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:20:12.298531 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-d2a46e12-07e9-499b-9548-4d535e4b64eb tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:12.299158 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-d2a46e12-07e9-499b-9548-4d535e4b64eb tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:12.305117 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d2a46e12-07e9-499b-9548-4d535e4b64eb tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:12.305596 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d2a46e12-07e9-499b-9548-4d535e4b64eb tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:12.306363 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d2a46e12-07e9-499b-9548-4d535e4b64eb tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:12.306890 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d2a46e12-07e9-499b-9548-4d535e4b64eb tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:12.427198 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-d2a46e12-07e9-499b-9548-4d535e4b64eb tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:12.434277 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-d2a46e12-07e9-499b-9548-4d535e4b64eb tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1521 microversion: 2.1 time: 0.140013 Oct 12 04:20:12.434860 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 307/613] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:12 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:20:12.641093 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-549f7bf3-9688-4f26-b627-3289c1b0d99f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:12.641702 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-549f7bf3-9688-4f26-b627-3289c1b0d99f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:12.647388 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-549f7bf3-9688-4f26-b627-3289c1b0d99f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:12.647838 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-549f7bf3-9688-4f26-b627-3289c1b0d99f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:12.648617 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-549f7bf3-9688-4f26-b627-3289c1b0d99f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:12.649033 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-549f7bf3-9688-4f26-b627-3289c1b0d99f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:12.771839 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-549f7bf3-9688-4f26-b627-3289c1b0d99f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:12.779004 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-549f7bf3-9688-4f26-b627-3289c1b0d99f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1674 microversion: 2.1 time: 0.141991 Oct 12 04:20:12.784576 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 307/614] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:12 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1674 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:20:13.451006 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-7eb61693-627b-4688-b2ed-9a2b249764bc tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:13.451570 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-7eb61693-627b-4688-b2ed-9a2b249764bc tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:13.457608 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7eb61693-627b-4688-b2ed-9a2b249764bc tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:13.458055 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7eb61693-627b-4688-b2ed-9a2b249764bc tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:13.463510 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7eb61693-627b-4688-b2ed-9a2b249764bc tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:13.463510 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7eb61693-627b-4688-b2ed-9a2b249764bc tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:13.518403 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-7eb61693-627b-4688-b2ed-9a2b249764bc tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf98793849634eb9b6b140f3b44d7371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9696ef17af304e61842be106e91706e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:13.532267 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-7eb61693-627b-4688-b2ed-9a2b249764bc tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 200 len: 1479 microversion: 2.1 time: 0.079887 Oct 12 04:20:13.532267 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 308/615] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:13 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 1479 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:20:13.574394 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-870d6c4d-816a-4838-acb9-da182b1450ec req-c1d3ab7c-96f4-4ac3-ad53-0562efc95c66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d927fdb5-40b1-4279-9f0c-7006831e05d2", "name": "network-vif-deleted", "tag": "820be35b-a456-4989-96da-b067b6759731"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:20:13.578054 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:20:13.578054 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:20:13.582597 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-870d6c4d-816a-4838-acb9-da182b1450ec req-c1d3ab7c-96f4-4ac3-ad53-0562efc95c66 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:13.583068 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-870d6c4d-816a-4838-acb9-da182b1450ec req-c1d3ab7c-96f4-4ac3-ad53-0562efc95c66 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:13.593895 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-870d6c4d-816a-4838-acb9-da182b1450ec req-c1d3ab7c-96f4-4ac3-ad53-0562efc95c66 service nova] Creating event network-vif-deleted:820be35b-a456-4989-96da-b067b6759731 for instance d927fdb5-40b1-4279-9f0c-7006831e05d2 on hv-cinder-81306 Oct 12 04:20:13.598809 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-870d6c4d-816a-4838-acb9-da182b1450ec req-c1d3ab7c-96f4-4ac3-ad53-0562efc95c66 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027985 Oct 12 04:20:13.599367 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 308/616] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:20:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:20:13.797018 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-521c33b3-5a06-4dcc-8f7e-cd0c2d8c2a06 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:13.797620 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-521c33b3-5a06-4dcc-8f7e-cd0c2d8c2a06 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:13.803297 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-521c33b3-5a06-4dcc-8f7e-cd0c2d8c2a06 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:13.803736 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-521c33b3-5a06-4dcc-8f7e-cd0c2d8c2a06 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:13.804484 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-521c33b3-5a06-4dcc-8f7e-cd0c2d8c2a06 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:13.804904 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-521c33b3-5a06-4dcc-8f7e-cd0c2d8c2a06 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:13.923533 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-521c33b3-5a06-4dcc-8f7e-cd0c2d8c2a06 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:13.930736 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-521c33b3-5a06-4dcc-8f7e-cd0c2d8c2a06 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1674 microversion: 2.1 time: 0.138204 Oct 12 04:20:13.931288 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 309/617] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:13 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1674 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:20:14.552280 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-7a245927-9862-4b7a-9512-d8869bf866be tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:14.552969 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-7a245927-9862-4b7a-9512-d8869bf866be tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] [instance: d927fdb5-40b1-4279-9f0c-7006831e05d2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:14.558855 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7a245927-9862-4b7a-9512-d8869bf866be tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:14.559306 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7a245927-9862-4b7a-9512-d8869bf866be tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:14.560563 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7a245927-9862-4b7a-9512-d8869bf866be tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:14.561013 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7a245927-9862-4b7a-9512-d8869bf866be tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:14.573872 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.wsgi [None req-7a245927-9862-4b7a-9512-d8869bf866be tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] HTTP exception thrown: Instance d927fdb5-40b1-4279-9f0c-7006831e05d2 could not be found. Oct 12 04:20:14.574455 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-7a245927-9862-4b7a-9512-d8869bf866be tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] Returning 404 to user: Instance d927fdb5-40b1-4279-9f0c-7006831e05d2 could not be found. {{(pid=108898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:20:14.576007 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-7a245927-9862-4b7a-9512-d8869bf866be tempest-ServerRescueNegativeTestJSON-1276768267 tempest-ServerRescueNegativeTestJSON-1276768267-project] 10.222.0.21 "GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2" status: 404 len: 111 microversion: 2.1 time: 0.035166 Oct 12 04:20:14.576545 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 309/618] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:14 2021] GET /compute/v2.1/servers/d927fdb5-40b1-4279-9f0c-7006831e05d2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:20:14.949237 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-11d63c5e-33c9-4078-9cd5-e4e32b9a34ab tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:14.949778 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-11d63c5e-33c9-4078-9cd5-e4e32b9a34ab tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:14.955666 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-11d63c5e-33c9-4078-9cd5-e4e32b9a34ab tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:14.956112 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-11d63c5e-33c9-4078-9cd5-e4e32b9a34ab tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:14.956881 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-11d63c5e-33c9-4078-9cd5-e4e32b9a34ab tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:14.957306 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-11d63c5e-33c9-4078-9cd5-e4e32b9a34ab tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:15.160100 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-11d63c5e-33c9-4078-9cd5-e4e32b9a34ab tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:15.167422 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-11d63c5e-33c9-4078-9cd5-e4e32b9a34ab tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1674 microversion: 2.1 time: 0.221918 Oct 12 04:20:15.167990 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 310/619] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:14 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1674 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:20:16.185490 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-42a7a478-21f6-43f9-8a41-8788b94e3201 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:16.186264 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-42a7a478-21f6-43f9-8a41-8788b94e3201 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:16.192349 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-42a7a478-21f6-43f9-8a41-8788b94e3201 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:16.192791 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-42a7a478-21f6-43f9-8a41-8788b94e3201 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:16.193558 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-42a7a478-21f6-43f9-8a41-8788b94e3201 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:16.194035 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-42a7a478-21f6-43f9-8a41-8788b94e3201 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:16.401516 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-42a7a478-21f6-43f9-8a41-8788b94e3201 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:16.408688 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-42a7a478-21f6-43f9-8a41-8788b94e3201 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1674 microversion: 2.1 time: 0.228113 Oct 12 04:20:16.409687 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 310/620] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:16 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1674 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:20:17.425847 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-4afb61b3-7a31-45a1-809f-7e41bd6f110e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:17.426566 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-4afb61b3-7a31-45a1-809f-7e41bd6f110e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:17.433209 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4afb61b3-7a31-45a1-809f-7e41bd6f110e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:17.433658 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4afb61b3-7a31-45a1-809f-7e41bd6f110e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:17.434959 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4afb61b3-7a31-45a1-809f-7e41bd6f110e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:17.435484 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4afb61b3-7a31-45a1-809f-7e41bd6f110e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:17.573862 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-4afb61b3-7a31-45a1-809f-7e41bd6f110e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:17.581988 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-4afb61b3-7a31-45a1-809f-7e41bd6f110e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1674 microversion: 2.1 time: 0.160565 Oct 12 04:20:17.583061 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 311/621] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:17 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:20:18.599764 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-4960b12a-70f2-4fbd-8305-5a912a16e58d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:18.600297 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-4960b12a-70f2-4fbd-8305-5a912a16e58d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:18.606377 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4960b12a-70f2-4fbd-8305-5a912a16e58d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:18.607022 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4960b12a-70f2-4fbd-8305-5a912a16e58d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:18.608045 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4960b12a-70f2-4fbd-8305-5a912a16e58d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:18.608478 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4960b12a-70f2-4fbd-8305-5a912a16e58d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:18.734288 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-4960b12a-70f2-4fbd-8305-5a912a16e58d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:18.741928 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-4960b12a-70f2-4fbd-8305-5a912a16e58d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1651 microversion: 2.1 time: 0.146387 Oct 12 04:20:18.742695 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 311/622] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:18 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1651 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:20:18.759455 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-f7987af3-2e0c-4eae-b433-3beb26914368 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:20:18.766043 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f7987af3-2e0c-4eae-b433-3beb26914368 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:18.766577 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f7987af3-2e0c-4eae-b433-3beb26914368 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:18.788035 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-f7987af3-2e0c-4eae-b433-3beb26914368 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Going to try to start instance {{(pid=108897) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 12 04:20:19.007429 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-f7987af3-2e0c-4eae-b433-3beb26914368 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action" status: 202 len: 0 microversion: 2.1 time: 0.251876 Oct 12 04:20:19.011924 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 312/623] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:20:18 2021] POST /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:20:19.016993 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-4cab878a-803c-445d-962e-0205aac22acf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:19.018510 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-4cab878a-803c-445d-962e-0205aac22acf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:19.024891 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4cab878a-803c-445d-962e-0205aac22acf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:19.025408 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4cab878a-803c-445d-962e-0205aac22acf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:19.026231 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4cab878a-803c-445d-962e-0205aac22acf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:19.026757 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4cab878a-803c-445d-962e-0205aac22acf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:19.205546 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-4cab878a-803c-445d-962e-0205aac22acf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:19.205546 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-4cab878a-803c-445d-962e-0205aac22acf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1660 microversion: 2.1 time: 0.156467 Oct 12 04:20:19.205546 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 312/624] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:19 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1660 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:20:19.939229 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-0288243e-95ae-4f1e-bf81-473826e527ed tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] Action: 'create', calling method: .version_select at 0x7f3855de9f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-282420977"}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:20:20.221641 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-e2b3908a-20e8-4b90-86a8-389024d14624 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:20.222319 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-e2b3908a-20e8-4b90-86a8-389024d14624 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:20.228037 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e2b3908a-20e8-4b90-86a8-389024d14624 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:20.228491 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e2b3908a-20e8-4b90-86a8-389024d14624 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:20.229259 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e2b3908a-20e8-4b90-86a8-389024d14624 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:20.229684 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e2b3908a-20e8-4b90-86a8-389024d14624 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:20.352630 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-e2b3908a-20e8-4b90-86a8-389024d14624 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:20.360443 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-e2b3908a-20e8-4b90-86a8-389024d14624 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1660 microversion: 2.1 time: 0.142456 Oct 12 04:20:20.361649 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 313/625] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:20 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1660 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:20:20.534894 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 04:20:20.535102 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: Tue Oct 12 04:20:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 12 04:20:20.613210 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-0288243e-95ae-4f1e-bf81-473826e527ed tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.783566 Oct 12 04:20:20.613855 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 313/626] 10.222.0.21 () {60 vars in 1154 bytes} [Tue Oct 12 04:20:19 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 785 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 12 04:20:20.624839 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-7e6ccc0f-7fab-444b-9547-2e91886aaa61 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] Calling method '.version_select at 0x7f385567c1f0>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:20.671659 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-7e6ccc0f-7fab-444b-9547-2e91886aaa61 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/fcd538a8-1d3a-423f-94d0-c07099fcf35b" status: 200 len: 344 microversion: 2.1 time: 0.050832 Oct 12 04:20:20.675930 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 314/627] 10.222.0.21 () {58 vars in 1244 bytes} [Tue Oct 12 04:20:20 2021] GET /compute/v2.1/os-volumes/fcd538a8-1d3a-423f-94d0-c07099fcf35b => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:20:21.378043 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-11dbba79-1f9c-4d98-bcc4-73832d78e98b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:21.378706 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-11dbba79-1f9c-4d98-bcc4-73832d78e98b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:21.384698 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-11dbba79-1f9c-4d98-bcc4-73832d78e98b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:21.385141 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-11dbba79-1f9c-4d98-bcc4-73832d78e98b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:21.385890 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-11dbba79-1f9c-4d98-bcc4-73832d78e98b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:21.386344 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-11dbba79-1f9c-4d98-bcc4-73832d78e98b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:21.511922 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-11dbba79-1f9c-4d98-bcc4-73832d78e98b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:21.519675 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-11dbba79-1f9c-4d98-bcc4-73832d78e98b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1664 microversion: 2.1 time: 0.145337 Oct 12 04:20:21.520232 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 314/628] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:21 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1664 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:20:21.683884 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-00308bc6-ba02-435c-9a4d-eae95601678b tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] Calling method '.version_select at 0x7f38556d0310>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:21.733095 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-00308bc6-ba02-435c-9a4d-eae95601678b tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/fcd538a8-1d3a-423f-94d0-c07099fcf35b" status: 200 len: 345 microversion: 2.1 time: 0.052585 Oct 12 04:20:21.733675 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 315/629] 10.222.0.21 () {58 vars in 1244 bytes} [Tue Oct 12 04:20:21 2021] GET /compute/v2.1/os-volumes/fcd538a8-1d3a-423f-94d0-c07099fcf35b => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:20:21.744840 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-cbf764b8-7c0a-489d-99d3-648e6683993b tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] Action: 'create', calling method: .version_select at 0x7f3855de9f70>, body: {"snapshot": {"volume_id": "fcd538a8-1d3a-423f-94d0-c07099fcf35b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-634653307"}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:20:22.193931 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-cbf764b8-7c0a-489d-99d3-648e6683993b tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] 10.222.0.21 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.452894 Oct 12 04:20:22.194501 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 315/630] 10.222.0.21 () {60 vars in 1161 bytes} [Tue Oct 12 04:20:21 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:20:22.207816 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d131a42f-af84-43e9-b40a-54ad733ac59a tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] Calling method '.version_select at 0x7f38556d0c10>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:22.232929 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-d131a42f-af84-43e9-b40a-54ad733ac59a tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/0b89d48f-592f-4d22-9844-d4ef2ca83915" status: 200 len: 286 microversion: 2.1 time: 0.031902 Oct 12 04:20:22.233578 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 316/631] 10.222.0.21 () {58 vars in 1250 bytes} [Tue Oct 12 04:20:22 2021] GET /compute/v2.1/os-snapshots/0b89d48f-592f-4d22-9844-d4ef2ca83915 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:20:22.242822 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-766407ff-a256-4813-b8a3-fa794b4462a5 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] Calling method '.version_select at 0x7f3855e37b80>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:22.271374 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-766407ff-a256-4813-b8a3-fa794b4462a5 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.032017 Oct 12 04:20:22.271926 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 316/632] 10.222.0.21 () {58 vars in 1139 bytes} [Tue Oct 12 04:20:22 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:20:22.281645 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-b96687d4-43f1-4246-9488-be891091f544 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] Calling method '.version_select at 0x7f38555ea160>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:22.309561 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-b96687d4-43f1-4246-9488-be891091f544 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/0b89d48f-592f-4d22-9844-d4ef2ca83915" status: 200 len: 286 microversion: 2.1 time: 0.031647 Oct 12 04:20:22.310098 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 317/633] 10.222.0.21 () {58 vars in 1250 bytes} [Tue Oct 12 04:20:22 2021] GET /compute/v2.1/os-snapshots/0b89d48f-592f-4d22-9844-d4ef2ca83915 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:20:23.321575 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-21769e98-edd0-4ba7-8d71-14212ec72122 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] Calling method '.version_select at 0x7f3855dd15e0>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:23.350871 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-21769e98-edd0-4ba7-8d71-14212ec72122 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/0b89d48f-592f-4d22-9844-d4ef2ca83915" status: 200 len: 286 microversion: 2.1 time: 0.032930 Oct 12 04:20:23.351421 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 317/634] 10.222.0.21 () {58 vars in 1250 bytes} [Tue Oct 12 04:20:23 2021] GET /compute/v2.1/os-snapshots/0b89d48f-592f-4d22-9844-d4ef2ca83915 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:20:24.362809 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-b7b90929-bd8d-4644-893f-ffde125959c6 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] Calling method '.version_select at 0x7f38556a2550>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:24.390311 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-b7b90929-bd8d-4644-893f-ffde125959c6 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/0b89d48f-592f-4d22-9844-d4ef2ca83915" status: 200 len: 286 microversion: 2.1 time: 0.031108 Oct 12 04:20:24.390864 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 318/635] 10.222.0.21 () {58 vars in 1250 bytes} [Tue Oct 12 04:20:24 2021] GET /compute/v2.1/os-snapshots/0b89d48f-592f-4d22-9844-d4ef2ca83915 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:20:25.401963 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-9568c41b-6d3a-4c6f-a768-b6ccb977ca8c tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] Calling method '.version_select at 0x7f3855dd1550>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:25.430362 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-9568c41b-6d3a-4c6f-a768-b6ccb977ca8c tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/0b89d48f-592f-4d22-9844-d4ef2ca83915" status: 200 len: 286 microversion: 2.1 time: 0.032142 Oct 12 04:20:25.430911 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 318/636] 10.222.0.21 () {58 vars in 1250 bytes} [Tue Oct 12 04:20:25 2021] GET /compute/v2.1/os-snapshots/0b89d48f-592f-4d22-9844-d4ef2ca83915 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:20:26.442184 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-15458ac8-3d1b-4fa8-a58a-df4a0bb08fa1 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] Calling method '.version_select at 0x7f3855639430>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:26.471076 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-15458ac8-3d1b-4fa8-a58a-df4a0bb08fa1 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/0b89d48f-592f-4d22-9844-d4ef2ca83915" status: 200 len: 287 microversion: 2.1 time: 0.032415 Oct 12 04:20:26.471627 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 319/637] 10.222.0.21 () {58 vars in 1250 bytes} [Tue Oct 12 04:20:26 2021] GET /compute/v2.1/os-snapshots/0b89d48f-592f-4d22-9844-d4ef2ca83915 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:20:26.481459 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ac847aec-0547-4946-acec-e114aa635c17 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] Calling method '.version_select at 0x7f3855e375e0>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:26.597992 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ac847aec-0547-4946-acec-e114aa635c17 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] 10.222.0.21 "DELETE /compute/v2.1/os-snapshots/0b89d48f-592f-4d22-9844-d4ef2ca83915" status: 202 len: 0 microversion: 2.1 time: 0.120162 Oct 12 04:20:26.598832 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 319/638] 10.222.0.21 () {58 vars in 1253 bytes} [Tue Oct 12 04:20:26 2021] DELETE /compute/v2.1/os-snapshots/0b89d48f-592f-4d22-9844-d4ef2ca83915 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:20:26.606389 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-0536950c-cbd2-4c52-b5df-e4fdbccad240 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] Calling method '.version_select at 0x7f3855639a60>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:26.636290 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-0536950c-cbd2-4c52-b5df-e4fdbccad240 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/0b89d48f-592f-4d22-9844-d4ef2ca83915" status: 200 len: 286 microversion: 2.1 time: 0.033391 Oct 12 04:20:26.636847 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 320/639] 10.222.0.21 () {58 vars in 1250 bytes} [Tue Oct 12 04:20:26 2021] GET /compute/v2.1/os-snapshots/0b89d48f-592f-4d22-9844-d4ef2ca83915 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:20:27.647790 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-70c90d9f-6aef-424a-8a20-429fd6cbe468 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] Calling method '.version_select at 0x7f3855e24670>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:27.671276 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.wsgi [None req-70c90d9f-6aef-424a-8a20-429fd6cbe468 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] HTTP exception thrown: Snapshot 0b89d48f-592f-4d22-9844-d4ef2ca83915 could not be found. Oct 12 04:20:27.671869 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-70c90d9f-6aef-424a-8a20-429fd6cbe468 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] Returning 404 to user: Snapshot 0b89d48f-592f-4d22-9844-d4ef2ca83915 could not be found. {{(pid=108897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:20:27.672679 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-70c90d9f-6aef-424a-8a20-429fd6cbe468 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/0b89d48f-592f-4d22-9844-d4ef2ca83915" status: 404 len: 111 microversion: 2.1 time: 0.028606 Oct 12 04:20:27.673213 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 320/640] 10.222.0.21 () {58 vars in 1250 bytes} [Tue Oct 12 04:20:27 2021] GET /compute/v2.1/os-snapshots/0b89d48f-592f-4d22-9844-d4ef2ca83915 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:20:27.681101 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-f4260683-e7c9-4282-a4b5-0656465a7961 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] Calling method '.version_select at 0x7f38556364c0>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:27.922271 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-f4260683-e7c9-4282-a4b5-0656465a7961 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/fcd538a8-1d3a-423f-94d0-c07099fcf35b" status: 202 len: 0 microversion: 2.1 time: 0.244869 Oct 12 04:20:27.922919 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 321/641] 10.222.0.21 () {58 vars in 1247 bytes} [Tue Oct 12 04:20:27 2021] DELETE /compute/v2.1/os-volumes/fcd538a8-1d3a-423f-94d0-c07099fcf35b => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:20:27.931272 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-5ade7ffd-7b92-4157-aa50-b4ef31331372 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] Calling method '.version_select at 0x7f3856237b80>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:27.976815 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-5ade7ffd-7b92-4157-aa50-b4ef31331372 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/fcd538a8-1d3a-423f-94d0-c07099fcf35b" status: 200 len: 344 microversion: 2.1 time: 0.048748 Oct 12 04:20:27.977306 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 321/642] 10.222.0.21 () {58 vars in 1244 bytes} [Tue Oct 12 04:20:27 2021] GET /compute/v2.1/os-volumes/fcd538a8-1d3a-423f-94d0-c07099fcf35b => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:20:28.992750 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-444b8c3d-6e77-4b7e-8b3c-e35d8d44d783 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] Calling method '.version_select at 0x7f38555eaee0>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:29.019156 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.wsgi [None req-444b8c3d-6e77-4b7e-8b3c-e35d8d44d783 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] HTTP exception thrown: Volume fcd538a8-1d3a-423f-94d0-c07099fcf35b could not be found. Oct 12 04:20:29.019742 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-444b8c3d-6e77-4b7e-8b3c-e35d8d44d783 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] Returning 404 to user: Volume fcd538a8-1d3a-423f-94d0-c07099fcf35b could not be found. {{(pid=108898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:20:29.020555 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-444b8c3d-6e77-4b7e-8b3c-e35d8d44d783 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/fcd538a8-1d3a-423f-94d0-c07099fcf35b" status: 404 len: 109 microversion: 2.1 time: 0.031454 Oct 12 04:20:29.021079 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 322/643] 10.222.0.21 () {58 vars in 1244 bytes} [Tue Oct 12 04:20:28 2021] GET /compute/v2.1/os-volumes/fcd538a8-1d3a-423f-94d0-c07099fcf35b => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:20:29.035069 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-73e57ddf-4540-45da-8966-9e0a25179ad9 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] Calling method '.version_select at 0x7f3855de9160>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:29.062097 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.wsgi [None req-73e57ddf-4540-45da-8966-9e0a25179ad9 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] HTTP exception thrown: Volume fcd538a8-1d3a-423f-94d0-c07099fcf35b could not be found. Oct 12 04:20:29.062097 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-73e57ddf-4540-45da-8966-9e0a25179ad9 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] Returning 404 to user: Volume fcd538a8-1d3a-423f-94d0-c07099fcf35b could not be found. {{(pid=108897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:20:29.062327 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-73e57ddf-4540-45da-8966-9e0a25179ad9 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/fcd538a8-1d3a-423f-94d0-c07099fcf35b" status: 404 len: 109 microversion: 2.1 time: 0.031677 Oct 12 04:20:29.062880 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 322/644] 10.222.0.21 () {58 vars in 1247 bytes} [Tue Oct 12 04:20:29 2021] DELETE /compute/v2.1/os-volumes/fcd538a8-1d3a-423f-94d0-c07099fcf35b => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:20:29.070968 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-3c702d2c-4b9c-4441-bb17-eae8c939f0f7 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] Calling method '.version_select at 0x7f385567c4c0>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:29.104117 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.wsgi [None req-3c702d2c-4b9c-4441-bb17-eae8c939f0f7 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] HTTP exception thrown: Volume fcd538a8-1d3a-423f-94d0-c07099fcf35b could not be found. Oct 12 04:20:29.104117 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-3c702d2c-4b9c-4441-bb17-eae8c939f0f7 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] Returning 404 to user: Volume fcd538a8-1d3a-423f-94d0-c07099fcf35b could not be found. {{(pid=108898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:20:29.104117 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-3c702d2c-4b9c-4441-bb17-eae8c939f0f7 tempest-VolumesSnapshotsTestJSON-503690255 tempest-VolumesSnapshotsTestJSON-503690255-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/fcd538a8-1d3a-423f-94d0-c07099fcf35b" status: 404 len: 109 microversion: 2.1 time: 0.031070 Oct 12 04:20:29.104117 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 323/645] 10.222.0.21 () {58 vars in 1244 bytes} [Tue Oct 12 04:20:29 2021] GET /compute/v2.1/os-volumes/fcd538a8-1d3a-423f-94d0-c07099fcf35b => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:20:36.426186 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-49ce1747-25bd-4174-8552-b5ae222883dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:36.426763 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-49ce1747-25bd-4174-8552-b5ae222883dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:36.433764 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-49ce1747-25bd-4174-8552-b5ae222883dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:36.434200 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-49ce1747-25bd-4174-8552-b5ae222883dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:36.435047 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-49ce1747-25bd-4174-8552-b5ae222883dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:36.435476 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-49ce1747-25bd-4174-8552-b5ae222883dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:36.467617 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-49ce1747-25bd-4174-8552-b5ae222883dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/os-volume_attachments/ae993f5f-7f78-4035-842f-49c51598ed9b" status: 200 len: 194 microversion: 2.20 time: 0.045491 Oct 12 04:20:36.480335 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 323/646] 10.222.0.21 () {60 vars in 1453 bytes} [Tue Oct 12 04:20:36 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/os-volume_attachments/ae993f5f-7f78-4035-842f-49c51598ed9b => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:20:36.528857 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-b16b42c0-5319-4e75-a163-407b083a5e26 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:36.530207 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-b16b42c0-5319-4e75-a163-407b083a5e26 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:36.538846 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b16b42c0-5319-4e75-a163-407b083a5e26 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:36.539398 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b16b42c0-5319-4e75-a163-407b083a5e26 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:36.540490 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b16b42c0-5319-4e75-a163-407b083a5e26 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:36.540926 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b16b42c0-5319-4e75-a163-407b083a5e26 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:36.618463 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.objects.instance [None req-b16b42c0-5319-4e75-a163-407b083a5e26 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lazy-loading 'services' on Instance uuid 29fcfae4-9349-4167-9403-9a4a20f346bd {{(pid=108898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:20:36.864478 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-b16b42c0-5319-4e75-a163-407b083a5e26 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "DELETE /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/os-volume_attachments/ae993f5f-7f78-4035-842f-49c51598ed9b" status: 202 len: 0 microversion: 2.20 time: 0.339070 Oct 12 04:20:36.865107 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 324/647] 10.222.0.21 () {60 vars in 1456 bytes} [Tue Oct 12 04:20:36 2021] DELETE /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/os-volume_attachments/ae993f5f-7f78-4035-842f-49c51598ed9b => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 04:20:36.873385 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-6230c5f2-7ea4-4433-a038-082ab8431d0e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:36.874320 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-6230c5f2-7ea4-4433-a038-082ab8431d0e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:36.880248 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6230c5f2-7ea4-4433-a038-082ab8431d0e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:36.880602 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6230c5f2-7ea4-4433-a038-082ab8431d0e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:36.881353 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6230c5f2-7ea4-4433-a038-082ab8431d0e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:36.881797 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6230c5f2-7ea4-4433-a038-082ab8431d0e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:36.911562 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-6230c5f2-7ea4-4433-a038-082ab8431d0e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041950 Oct 12 04:20:36.912117 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 324/648] 10.222.0.21 () {60 vars in 1342 bytes} [Tue Oct 12 04:20:36 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 04:20:37.924293 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-557d0ffa-9a26-4c5a-bf83-3ffe0e4a2f3d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:37.925259 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-557d0ffa-9a26-4c5a-bf83-3ffe0e4a2f3d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:37.931352 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-557d0ffa-9a26-4c5a-bf83-3ffe0e4a2f3d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:37.931788 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-557d0ffa-9a26-4c5a-bf83-3ffe0e4a2f3d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:37.932571 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-557d0ffa-9a26-4c5a-bf83-3ffe0e4a2f3d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:37.933015 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-557d0ffa-9a26-4c5a-bf83-3ffe0e4a2f3d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:37.964731 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-557d0ffa-9a26-4c5a-bf83-3ffe0e4a2f3d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045119 Oct 12 04:20:37.965278 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 325/649] 10.222.0.21 () {60 vars in 1342 bytes} [Tue Oct 12 04:20:37 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:20:38.022312 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-defac1ba-7085-44b6-bc9e-969426fc0b6c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:38.023075 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-defac1ba-7085-44b6-bc9e-969426fc0b6c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:38.029212 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-defac1ba-7085-44b6-bc9e-969426fc0b6c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:38.029669 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-defac1ba-7085-44b6-bc9e-969426fc0b6c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:38.032828 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-defac1ba-7085-44b6-bc9e-969426fc0b6c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:38.032828 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-defac1ba-7085-44b6-bc9e-969426fc0b6c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:38.056992 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-defac1ba-7085-44b6-bc9e-969426fc0b6c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Going to try to terminate instance {{(pid=108897) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 04:20:38.414406 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-defac1ba-7085-44b6-bc9e-969426fc0b6c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "DELETE /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 204 len: 0 microversion: 2.20 time: 0.395767 Oct 12 04:20:38.415008 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 325/650] 10.222.0.21 () {60 vars in 1279 bytes} [Tue Oct 12 04:20:38 2021] DELETE /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 04:20:38.422984 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-73a12cdd-d0b1-4b87-82cb-64fce1d5fd20 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:38.423602 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-73a12cdd-d0b1-4b87-82cb-64fce1d5fd20 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:38.429304 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-73a12cdd-d0b1-4b87-82cb-64fce1d5fd20 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:38.429747 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-73a12cdd-d0b1-4b87-82cb-64fce1d5fd20 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:38.430546 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-73a12cdd-d0b1-4b87-82cb-64fce1d5fd20 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:38.431004 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-73a12cdd-d0b1-4b87-82cb-64fce1d5fd20 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:38.567385 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-73a12cdd-d0b1-4b87-82cb-64fce1d5fd20 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:38.580077 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-73a12cdd-d0b1-4b87-82cb-64fce1d5fd20 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:38.582048 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-73a12cdd-d0b1-4b87-82cb-64fce1d5fd20 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:38.583256 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-73a12cdd-d0b1-4b87-82cb-64fce1d5fd20 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1722 microversion: 2.20 time: 0.163913 Oct 12 04:20:38.583796 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 326/651] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:20:38 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:20:39.604882 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-a14cbab4-b9b5-4e33-9eb5-63a380a19b2a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:39.605703 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-a14cbab4-b9b5-4e33-9eb5-63a380a19b2a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:39.612741 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a14cbab4-b9b5-4e33-9eb5-63a380a19b2a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:39.613185 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a14cbab4-b9b5-4e33-9eb5-63a380a19b2a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:39.614191 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a14cbab4-b9b5-4e33-9eb5-63a380a19b2a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:39.615023 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a14cbab4-b9b5-4e33-9eb5-63a380a19b2a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:39.735788 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-a14cbab4-b9b5-4e33-9eb5-63a380a19b2a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:39.743459 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-a14cbab4-b9b5-4e33-9eb5-63a380a19b2a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:39.745039 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-a14cbab4-b9b5-4e33-9eb5-63a380a19b2a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:39.746199 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-a14cbab4-b9b5-4e33-9eb5-63a380a19b2a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1722 microversion: 2.20 time: 0.147205 Oct 12 04:20:39.746757 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 326/652] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:20:39 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:20:40.764494 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-6141210e-9fc3-49b3-9009-fcba4c5d4fbb tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:40.765175 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-6141210e-9fc3-49b3-9009-fcba4c5d4fbb tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:40.771241 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6141210e-9fc3-49b3-9009-fcba4c5d4fbb tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:40.771838 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6141210e-9fc3-49b3-9009-fcba4c5d4fbb tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:40.772733 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6141210e-9fc3-49b3-9009-fcba4c5d4fbb tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:40.773495 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6141210e-9fc3-49b3-9009-fcba4c5d4fbb tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:40.907572 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-6141210e-9fc3-49b3-9009-fcba4c5d4fbb tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:40.919268 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-6141210e-9fc3-49b3-9009-fcba4c5d4fbb tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:40.920765 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-6141210e-9fc3-49b3-9009-fcba4c5d4fbb tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:40.922907 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-6141210e-9fc3-49b3-9009-fcba4c5d4fbb tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1722 microversion: 2.20 time: 0.162103 Oct 12 04:20:40.923896 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 327/653] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:20:40 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:20:41.360082 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-81e762be-2618-4717-8531-41355d563566 req-bdd88fe6-c404-4cb6-b5bf-a226fe71e745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29fcfae4-9349-4167-9403-9a4a20f346bd", "name": "network-vif-deleted", "tag": "c5a9a497-7d69-4ed5-85cb-fa9a1cc1b4bf"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:20:41.363858 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:20:41.363858 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:20:41.372557 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-81e762be-2618-4717-8531-41355d563566 req-bdd88fe6-c404-4cb6-b5bf-a226fe71e745 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:41.373313 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-81e762be-2618-4717-8531-41355d563566 req-bdd88fe6-c404-4cb6-b5bf-a226fe71e745 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:41.388268 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-81e762be-2618-4717-8531-41355d563566 req-bdd88fe6-c404-4cb6-b5bf-a226fe71e745 service nova] Creating event network-vif-deleted:c5a9a497-7d69-4ed5-85cb-fa9a1cc1b4bf for instance 29fcfae4-9349-4167-9403-9a4a20f346bd on hv-cinder-81306 Oct 12 04:20:41.394301 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-81e762be-2618-4717-8531-41355d563566 req-bdd88fe6-c404-4cb6-b5bf-a226fe71e745 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039510 Oct 12 04:20:41.395513 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 327/654] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:20:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:20:41.943098 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-0649c6e0-ffcc-4c34-80cd-d8300e5bd4cf tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:41.943980 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-0649c6e0-ffcc-4c34-80cd-d8300e5bd4cf tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:41.955250 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0649c6e0-ffcc-4c34-80cd-d8300e5bd4cf tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:41.955963 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0649c6e0-ffcc-4c34-80cd-d8300e5bd4cf tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:41.957235 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0649c6e0-ffcc-4c34-80cd-d8300e5bd4cf tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:41.957979 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0649c6e0-ffcc-4c34-80cd-d8300e5bd4cf tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:41.999495 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0649c6e0-ffcc-4c34-80cd-d8300e5bd4cf tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:42.000193 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0649c6e0-ffcc-4c34-80cd-d8300e5bd4cf tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:42.000787 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.objects.instance [None req-0649c6e0-ffcc-4c34-80cd-d8300e5bd4cf tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lazy-loading 'fault' on Instance uuid 29fcfae4-9349-4167-9403-9a4a20f346bd {{(pid=108898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:20:42.052386 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-0649c6e0-ffcc-4c34-80cd-d8300e5bd4cf tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:42.066516 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-0649c6e0-ffcc-4c34-80cd-d8300e5bd4cf tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:42.069517 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-0649c6e0-ffcc-4c34-80cd-d8300e5bd4cf tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:42.071060 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-0649c6e0-ffcc-4c34-80cd-d8300e5bd4cf tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 200 len: 1371 microversion: 2.20 time: 0.132920 Oct 12 04:20:42.071790 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 328/655] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:20:41 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 1371 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:20:43.090791 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-6befb082-d1ac-4e62-ac2f-5c123c5bc42a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:43.091801 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-6befb082-d1ac-4e62-ac2f-5c123c5bc42a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:43.098718 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6befb082-d1ac-4e62-ac2f-5c123c5bc42a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:43.099181 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6befb082-d1ac-4e62-ac2f-5c123c5bc42a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:43.100020 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6befb082-d1ac-4e62-ac2f-5c123c5bc42a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:43.100520 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6befb082-d1ac-4e62-ac2f-5c123c5bc42a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:43.114755 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.wsgi [None req-6befb082-d1ac-4e62-ac2f-5c123c5bc42a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] HTTP exception thrown: Instance 29fcfae4-9349-4167-9403-9a4a20f346bd could not be found. Oct 12 04:20:43.115420 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-6befb082-d1ac-4e62-ac2f-5c123c5bc42a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Returning 404 to user: Instance 29fcfae4-9349-4167-9403-9a4a20f346bd could not be found. {{(pid=108897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:20:43.116305 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-6befb082-d1ac-4e62-ac2f-5c123c5bc42a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 404 len: 111 microversion: 2.20 time: 0.030730 Oct 12 04:20:43.116907 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 328/656] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:20:43 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 04:20:43.125005 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-11275380-c7a0-4f5c-b06f-4154a8fa85c0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '.version_select at 0x7f38556d09d0>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:43.192544 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-11275380-c7a0-4f5c-b06f-4154a8fa85c0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-193170031" status: 204 len: 0 microversion: 2.20 time: 0.071050 Oct 12 04:20:43.193100 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 329/657] 10.222.0.21 () {60 vars in 1258 bytes} [Tue Oct 12 04:20:43 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-193170031 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 04:20:43.987967 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-a289ec46-b87c-4b75-a9a1-f243d39990dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'create', calling method: .version_select at 0x7f3855dd1550>, body: {"keypair": {"name": "tempest-keypair-982511812"}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:20:44.015220 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-a289ec46-b87c-4b75-a9a1-f243d39990dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Getting quotas for project 94eb0d66d77a44dba68f16a5d05cbe28. Resources: {'key_pairs'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:20:44.018975 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-a289ec46-b87c-4b75-a9a1-f243d39990dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Getting quotas for user eacda2627f3a4e20a265952eb29b41d9 and project 94eb0d66d77a44dba68f16a5d05cbe28. Resources: {'key_pairs'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:20:44.245161 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-a289ec46-b87c-4b75-a9a1-f243d39990dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Getting quotas for project 94eb0d66d77a44dba68f16a5d05cbe28. Resources: {'key_pairs'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:20:44.248987 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-a289ec46-b87c-4b75-a9a1-f243d39990dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Getting quotas for user eacda2627f3a4e20a265952eb29b41d9 and project 94eb0d66d77a44dba68f16a5d05cbe28. Resources: {'key_pairs'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:20:44.261875 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-a289ec46-b87c-4b75-a9a1-f243d39990dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.278355 Oct 12 04:20:44.262591 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 329/658] 10.222.0.21 () {62 vars in 1198 bytes} [Tue Oct 12 04:20:43 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 280 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Oct 12 04:20:46.723111 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-c5f3e5e0-9475-49a9-bb3c-aa7cf56d94dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2074858332", "imageRef": "bf8c5573-3890-45dc-aec8-b1ad89136f80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7c7c1cf8-2399-44c9-829e-9a108f01a5bc"}], "security_groups": [{"name": "tempest-securitygroup--56497991"}], "key_name": "tempest-keypair-982511812", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:20:46.828067 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.network.neutron [None req-c5f3e5e0-9475-49a9-bb3c-aa7cf56d94dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] validate_networks() for [('7c7c1cf8-2399-44c9-829e-9a108f01a5bc', None, None, None, None, None)] {{(pid=108898) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 04:20:47.204470 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-c5f3e5e0-9475-49a9-bb3c-aa7cf56d94dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Flavor limits 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 04:20:47.204883 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-c5f3e5e0-9475-49a9-bb3c-aa7cf56d94dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Image limits 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 04:20:47.205403 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-c5f3e5e0-9475-49a9-bb3c-aa7cf56d94dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Flavor pref 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 04:20:47.205920 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-c5f3e5e0-9475-49a9-bb3c-aa7cf56d94dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Image pref 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 04:20:47.206326 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-c5f3e5e0-9475-49a9-bb3c-aa7cf56d94dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 04:20:47.214631 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c5f3e5e0-9475-49a9-bb3c-aa7cf56d94dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:47.215090 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c5f3e5e0-9475-49a9-bb3c-aa7cf56d94dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:47.215870 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c5f3e5e0-9475-49a9-bb3c-aa7cf56d94dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:47.216288 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c5f3e5e0-9475-49a9-bb3c-aa7cf56d94dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:47.231801 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-c5f3e5e0-9475-49a9-bb3c-aa7cf56d94dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Getting quotas for project 94eb0d66d77a44dba68f16a5d05cbe28. Resources: {'cores', 'instances', 'ram'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:20:47.236014 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-c5f3e5e0-9475-49a9-bb3c-aa7cf56d94dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Getting quotas for user eacda2627f3a4e20a265952eb29b41d9 and project 94eb0d66d77a44dba68f16a5d05cbe28. Resources: {'cores', 'instances', 'ram'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:20:47.246377 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-c5f3e5e0-9475-49a9-bb3c-aa7cf56d94dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Going to run 1 instances... {{(pid=108898) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 04:20:47.248696 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-c5f3e5e0-9475-49a9-bb3c-aa7cf56d94dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf8c5573-3890-45dc-aec8-b1ad89136f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108898) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 04:20:47.431411 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-c5f3e5e0-9475-49a9-bb3c-aa7cf56d94dd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.712813 Oct 12 04:20:47.431976 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 330/659] 10.222.0.21 () {62 vars in 1187 bytes} [Tue Oct 12 04:20:46 2021] POST /compute/v2.1/servers => generated 400 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 12 04:20:47.442355 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-5f11274a-7f9f-43bc-bd50-55f2b8a5785d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:47.443004 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-5f11274a-7f9f-43bc-bd50-55f2b8a5785d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:47.499160 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-5f11274a-7f9f-43bc-bd50-55f2b8a5785d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:47.506444 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-5f11274a-7f9f-43bc-bd50-55f2b8a5785d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:47.508148 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-5f11274a-7f9f-43bc-bd50-55f2b8a5785d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:47.509232 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-5f11274a-7f9f-43bc-bd50-55f2b8a5785d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1281 microversion: 2.20 time: 0.070614 Oct 12 04:20:47.509832 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 330/660] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:20:47 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:20:48.527893 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-9b6c71af-d5e0-4e56-a508-bdc529acf088 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:48.528501 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-9b6c71af-d5e0-4e56-a508-bdc529acf088 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:48.535194 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9b6c71af-d5e0-4e56-a508-bdc529acf088 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:48.535704 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9b6c71af-d5e0-4e56-a508-bdc529acf088 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:48.536446 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9b6c71af-d5e0-4e56-a508-bdc529acf088 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:48.536876 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9b6c71af-d5e0-4e56-a508-bdc529acf088 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:48.603936 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-9b6c71af-d5e0-4e56-a508-bdc529acf088 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:48.608163 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-9b6c71af-d5e0-4e56-a508-bdc529acf088 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:48.609705 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-9b6c71af-d5e0-4e56-a508-bdc529acf088 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:48.610837 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-9b6c71af-d5e0-4e56-a508-bdc529acf088 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1285 microversion: 2.20 time: 0.086633 Oct 12 04:20:48.611374 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 331/661] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:20:48 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:20:49.629304 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-fb318bec-e019-4909-bacf-da77479e6b8b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:49.629912 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-fb318bec-e019-4909-bacf-da77479e6b8b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:49.637740 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fb318bec-e019-4909-bacf-da77479e6b8b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:49.638194 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fb318bec-e019-4909-bacf-da77479e6b8b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:49.639036 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fb318bec-e019-4909-bacf-da77479e6b8b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:49.639473 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fb318bec-e019-4909-bacf-da77479e6b8b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:49.702180 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-fb318bec-e019-4909-bacf-da77479e6b8b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:49.710158 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-fb318bec-e019-4909-bacf-da77479e6b8b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:49.711667 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-fb318bec-e019-4909-bacf-da77479e6b8b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:49.712868 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-fb318bec-e019-4909-bacf-da77479e6b8b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1341 microversion: 2.20 time: 0.087767 Oct 12 04:20:49.713411 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 331/662] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:20:49 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1341 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:20:50.730887 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-e380dd7f-0990-4e39-b912-001d24602a60 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:50.731553 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-e380dd7f-0990-4e39-b912-001d24602a60 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:50.739111 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e380dd7f-0990-4e39-b912-001d24602a60 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:50.739556 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e380dd7f-0990-4e39-b912-001d24602a60 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:50.740329 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e380dd7f-0990-4e39-b912-001d24602a60 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:50.740761 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e380dd7f-0990-4e39-b912-001d24602a60 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:50.864270 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-e380dd7f-0990-4e39-b912-001d24602a60 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:50.872996 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-e380dd7f-0990-4e39-b912-001d24602a60 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:50.873916 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-e380dd7f-0990-4e39-b912-001d24602a60 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:50.875624 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-e380dd7f-0990-4e39-b912-001d24602a60 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1405 microversion: 2.20 time: 0.148086 Oct 12 04:20:50.876179 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 332/663] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:20:50 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:20:51.218145 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-8cedf621-b14e-4009-8396-d600c3dbe3fa req-a9d954a3-4555-4b1a-ab2d-e637da4595a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12862c4a-cd3e-4b8e-91b3-9dbe108af390", "tag": "5617efe3-71de-4588-bef7-3cd445452960"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:20:51.220807 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:20:51.220807 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:20:51.229880 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-8cedf621-b14e-4009-8396-d600c3dbe3fa req-a9d954a3-4555-4b1a-ab2d-e637da4595a8 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:51.229880 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-8cedf621-b14e-4009-8396-d600c3dbe3fa req-a9d954a3-4555-4b1a-ab2d-e637da4595a8 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:51.245160 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-8cedf621-b14e-4009-8396-d600c3dbe3fa req-a9d954a3-4555-4b1a-ab2d-e637da4595a8 service nova] Creating event network-changed:5617efe3-71de-4588-bef7-3cd445452960 for instance 12862c4a-cd3e-4b8e-91b3-9dbe108af390 on hv-cinder-81306 Oct 12 04:20:51.256701 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-8cedf621-b14e-4009-8396-d600c3dbe3fa req-a9d954a3-4555-4b1a-ab2d-e637da4595a8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042435 Oct 12 04:20:51.256701 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 332/664] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:20:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:20:51.893198 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-c91c8ba2-9b71-4549-a9bc-30c7839aed0b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:51.893827 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-c91c8ba2-9b71-4549-a9bc-30c7839aed0b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:51.899592 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c91c8ba2-9b71-4549-a9bc-30c7839aed0b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:51.900037 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c91c8ba2-9b71-4549-a9bc-30c7839aed0b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:51.900796 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c91c8ba2-9b71-4549-a9bc-30c7839aed0b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:51.901226 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c91c8ba2-9b71-4549-a9bc-30c7839aed0b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:52.058962 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c91c8ba2-9b71-4549-a9bc-30c7839aed0b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:52.066703 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c91c8ba2-9b71-4549-a9bc-30c7839aed0b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:52.068198 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c91c8ba2-9b71-4549-a9bc-30c7839aed0b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:52.069286 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-c91c8ba2-9b71-4549-a9bc-30c7839aed0b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1405 microversion: 2.20 time: 0.179863 Oct 12 04:20:52.069839 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 333/665] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:20:51 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:20:53.088090 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-e586f2d9-e9b5-40f8-b3da-ddd80796f6c6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:53.088904 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-e586f2d9-e9b5-40f8-b3da-ddd80796f6c6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:53.094967 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e586f2d9-e9b5-40f8-b3da-ddd80796f6c6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:53.095431 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e586f2d9-e9b5-40f8-b3da-ddd80796f6c6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:53.096198 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e586f2d9-e9b5-40f8-b3da-ddd80796f6c6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:53.096629 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e586f2d9-e9b5-40f8-b3da-ddd80796f6c6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:53.243023 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-e586f2d9-e9b5-40f8-b3da-ddd80796f6c6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:53.250564 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-e586f2d9-e9b5-40f8-b3da-ddd80796f6c6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:53.252092 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-e586f2d9-e9b5-40f8-b3da-ddd80796f6c6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:53.253184 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-e586f2d9-e9b5-40f8-b3da-ddd80796f6c6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1405 microversion: 2.20 time: 0.169115 Oct 12 04:20:53.253730 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 333/666] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:20:53 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:20:54.280481 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-df5ba457-c16b-4ff4-aa79-e308553b8518 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:54.281763 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-df5ba457-c16b-4ff4-aa79-e308553b8518 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:54.290286 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-df5ba457-c16b-4ff4-aa79-e308553b8518 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:54.291185 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-df5ba457-c16b-4ff4-aa79-e308553b8518 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:54.292317 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-df5ba457-c16b-4ff4-aa79-e308553b8518 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:54.292918 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-df5ba457-c16b-4ff4-aa79-e308553b8518 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:54.300884 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-3dba71dc-c984-4859-8f82-69348e7bd339 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:54.302092 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-3dba71dc-c984-4859-8f82-69348e7bd339 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:54.308742 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3dba71dc-c984-4859-8f82-69348e7bd339 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:54.309183 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3dba71dc-c984-4859-8f82-69348e7bd339 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:54.309944 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3dba71dc-c984-4859-8f82-69348e7bd339 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:54.310367 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3dba71dc-c984-4859-8f82-69348e7bd339 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:54.340426 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-3dba71dc-c984-4859-8f82-69348e7bd339 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045319 Oct 12 04:20:54.340975 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 334/667] 10.222.0.21 () {58 vars in 1301 bytes} [Tue Oct 12 04:20:54 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 04:20:54.402147 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ee798b87-a8cb-4f8d-8f4d-baff286c474e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:54.402645 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ee798b87-a8cb-4f8d-8f4d-baff286c474e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:54.408793 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ee798b87-a8cb-4f8d-8f4d-baff286c474e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:54.409257 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ee798b87-a8cb-4f8d-8f4d-baff286c474e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:54.410101 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ee798b87-a8cb-4f8d-8f4d-baff286c474e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:54.410547 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ee798b87-a8cb-4f8d-8f4d-baff286c474e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:54.436544 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ee798b87-a8cb-4f8d-8f4d-baff286c474e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Going to try to terminate instance {{(pid=108897) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 04:20:54.443072 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-df5ba457-c16b-4ff4-aa79-e308553b8518 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:54.451328 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-df5ba457-c16b-4ff4-aa79-e308553b8518 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:54.453869 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-df5ba457-c16b-4ff4-aa79-e308553b8518 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:54.454525 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-df5ba457-c16b-4ff4-aa79-e308553b8518 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1405 microversion: 2.20 time: 0.183912 Oct 12 04:20:54.455115 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 334/668] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:20:54 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:20:54.740023 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ee798b87-a8cb-4f8d-8f4d-baff286c474e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "DELETE /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 204 len: 0 microversion: 2.1 time: 0.341222 Oct 12 04:20:54.740624 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 335/669] 10.222.0.21 () {58 vars in 1238 bytes} [Tue Oct 12 04:20:54 2021] DELETE /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 04:20:54.748918 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-b6760cb9-a5b7-4da8-ba95-8603705dfdf2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:54.749521 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-b6760cb9-a5b7-4da8-ba95-8603705dfdf2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:54.758133 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b6760cb9-a5b7-4da8-ba95-8603705dfdf2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:54.759501 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b6760cb9-a5b7-4da8-ba95-8603705dfdf2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:54.762625 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b6760cb9-a5b7-4da8-ba95-8603705dfdf2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:54.763085 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b6760cb9-a5b7-4da8-ba95-8603705dfdf2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:54.903568 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-b6760cb9-a5b7-4da8-ba95-8603705dfdf2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:54.919773 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-b6760cb9-a5b7-4da8-ba95-8603705dfdf2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1670 microversion: 2.1 time: 0.174586 Oct 12 04:20:54.920348 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 335/670] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:54 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1670 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:20:55.473400 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-3b30c523-c392-452b-80d3-0e830c2f350e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:55.474093 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-3b30c523-c392-452b-80d3-0e830c2f350e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:55.480045 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3b30c523-c392-452b-80d3-0e830c2f350e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:55.480491 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3b30c523-c392-452b-80d3-0e830c2f350e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:55.481362 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3b30c523-c392-452b-80d3-0e830c2f350e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:55.481776 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3b30c523-c392-452b-80d3-0e830c2f350e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:55.609116 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-3b30c523-c392-452b-80d3-0e830c2f350e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:55.617419 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-3b30c523-c392-452b-80d3-0e830c2f350e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:55.618922 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-3b30c523-c392-452b-80d3-0e830c2f350e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:55.620004 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-3b30c523-c392-452b-80d3-0e830c2f350e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1405 microversion: 2.20 time: 0.151311 Oct 12 04:20:55.620550 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 336/671] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:20:55 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:20:55.936548 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-8ae0d8ad-9149-4e84-b137-bbe1a2c8627d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:55.937283 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-8ae0d8ad-9149-4e84-b137-bbe1a2c8627d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:55.944774 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8ae0d8ad-9149-4e84-b137-bbe1a2c8627d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:55.945988 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8ae0d8ad-9149-4e84-b137-bbe1a2c8627d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:55.947196 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8ae0d8ad-9149-4e84-b137-bbe1a2c8627d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:55.949668 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8ae0d8ad-9149-4e84-b137-bbe1a2c8627d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:56.077423 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-8ae0d8ad-9149-4e84-b137-bbe1a2c8627d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:56.084973 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-8ae0d8ad-9149-4e84-b137-bbe1a2c8627d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1670 microversion: 2.1 time: 0.151983 Oct 12 04:20:56.085525 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 336/672] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:55 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1670 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:20:56.637169 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-b40195b8-6ac3-4a2b-aeda-1d3425c06222 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:56.637769 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-b40195b8-6ac3-4a2b-aeda-1d3425c06222 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:56.643951 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b40195b8-6ac3-4a2b-aeda-1d3425c06222 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:56.644433 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b40195b8-6ac3-4a2b-aeda-1d3425c06222 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:56.645178 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b40195b8-6ac3-4a2b-aeda-1d3425c06222 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:56.645606 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b40195b8-6ac3-4a2b-aeda-1d3425c06222 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:56.784775 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-b40195b8-6ac3-4a2b-aeda-1d3425c06222 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:56.792523 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-b40195b8-6ac3-4a2b-aeda-1d3425c06222 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:56.793999 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-b40195b8-6ac3-4a2b-aeda-1d3425c06222 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:56.795225 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-b40195b8-6ac3-4a2b-aeda-1d3425c06222 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1405 microversion: 2.20 time: 0.161764 Oct 12 04:20:56.798255 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 337/673] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:20:56 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:20:57.140347 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-39518af4-bdad-41db-a1c8-8fd22ad9c9e7 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:57.141728 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-39518af4-bdad-41db-a1c8-8fd22ad9c9e7 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:57.147983 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-39518af4-bdad-41db-a1c8-8fd22ad9c9e7 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:57.148541 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-39518af4-bdad-41db-a1c8-8fd22ad9c9e7 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:57.149327 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-39518af4-bdad-41db-a1c8-8fd22ad9c9e7 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:57.149759 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-39518af4-bdad-41db-a1c8-8fd22ad9c9e7 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:57.279727 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-39518af4-bdad-41db-a1c8-8fd22ad9c9e7 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:57.286899 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-39518af4-bdad-41db-a1c8-8fd22ad9c9e7 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1670 microversion: 2.1 time: 0.150376 Oct 12 04:20:57.289410 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 337/674] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:57 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1670 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:20:57.727419 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-d0089c0f-a21e-43c3-9df9-edc36b94ce67 req-9dc39044-0b77-4b74-9acf-8b71c4064676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12862c4a-cd3e-4b8e-91b3-9dbe108af390", "name": "network-vif-plugged", "status": "completed", "tag": "5617efe3-71de-4588-bef7-3cd445452960"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:20:57.729142 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:20:57.729142 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:20:57.738486 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-d0089c0f-a21e-43c3-9df9-edc36b94ce67 req-9dc39044-0b77-4b74-9acf-8b71c4064676 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:57.738966 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-d0089c0f-a21e-43c3-9df9-edc36b94ce67 req-9dc39044-0b77-4b74-9acf-8b71c4064676 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:57.749848 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-d0089c0f-a21e-43c3-9df9-edc36b94ce67 req-9dc39044-0b77-4b74-9acf-8b71c4064676 service nova] Creating event network-vif-plugged:5617efe3-71de-4588-bef7-3cd445452960 for instance 12862c4a-cd3e-4b8e-91b3-9dbe108af390 on hv-cinder-81306 Oct 12 04:20:57.760612 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-d0089c0f-a21e-43c3-9df9-edc36b94ce67 req-9dc39044-0b77-4b74-9acf-8b71c4064676 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038663 Oct 12 04:20:57.761245 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 338/675] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:20:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:20:57.816209 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-74a9effb-d13c-41fd-894a-8ffd33f80dfa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:57.817797 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-74a9effb-d13c-41fd-894a-8ffd33f80dfa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:57.827610 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-74a9effb-d13c-41fd-894a-8ffd33f80dfa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:57.828286 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-74a9effb-d13c-41fd-894a-8ffd33f80dfa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:57.829341 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-74a9effb-d13c-41fd-894a-8ffd33f80dfa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:57.829997 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-74a9effb-d13c-41fd-894a-8ffd33f80dfa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:57.960173 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-7c0c6873-62c3-47c5-954e-1fe981858baa req-1b360579-a237-4211-a35e-dc733df2e434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbee8a27-52f2-42c0-8cb5-bfade5bfb587", "name": "network-vif-deleted", "tag": "8580464d-5ebb-48ed-ba90-238466c4d35b"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:20:57.962808 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:20:57.962808 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:20:57.972374 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-7c0c6873-62c3-47c5-954e-1fe981858baa req-1b360579-a237-4211-a35e-dc733df2e434 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:57.973115 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-7c0c6873-62c3-47c5-954e-1fe981858baa req-1b360579-a237-4211-a35e-dc733df2e434 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:57.991505 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-74a9effb-d13c-41fd-894a-8ffd33f80dfa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:57.991741 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-7c0c6873-62c3-47c5-954e-1fe981858baa req-1b360579-a237-4211-a35e-dc733df2e434 service nova] Creating event network-vif-deleted:8580464d-5ebb-48ed-ba90-238466c4d35b for instance bbee8a27-52f2-42c0-8cb5-bfade5bfb587 on hv-cinder-81306 Oct 12 04:20:57.999650 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-74a9effb-d13c-41fd-894a-8ffd33f80dfa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:58.002703 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-74a9effb-d13c-41fd-894a-8ffd33f80dfa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:58.002966 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-7c0c6873-62c3-47c5-954e-1fe981858baa req-1b360579-a237-4211-a35e-dc733df2e434 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047564 Oct 12 04:20:58.004845 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-74a9effb-d13c-41fd-894a-8ffd33f80dfa tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1405 microversion: 2.20 time: 0.195422 Oct 12 04:20:58.006125 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 338/676] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:20:57 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1405 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:20:58.013179 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 339/677] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:20:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:20:58.304414 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-4777ee6b-11c9-45d9-a65e-b3ceb33398cf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:58.305147 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-4777ee6b-11c9-45d9-a65e-b3ceb33398cf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:58.311069 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4777ee6b-11c9-45d9-a65e-b3ceb33398cf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:58.311513 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4777ee6b-11c9-45d9-a65e-b3ceb33398cf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:58.312279 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4777ee6b-11c9-45d9-a65e-b3ceb33398cf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:58.312772 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4777ee6b-11c9-45d9-a65e-b3ceb33398cf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:58.344742 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4777ee6b-11c9-45d9-a65e-b3ceb33398cf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:58.345199 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4777ee6b-11c9-45d9-a65e-b3ceb33398cf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:58.345714 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.objects.instance [None req-4777ee6b-11c9-45d9-a65e-b3ceb33398cf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lazy-loading 'fault' on Instance uuid bbee8a27-52f2-42c0-8cb5-bfade5bfb587 {{(pid=108898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:20:58.386493 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-4777ee6b-11c9-45d9-a65e-b3ceb33398cf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:58.398061 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-4777ee6b-11c9-45d9-a65e-b3ceb33398cf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 200 len: 1327 microversion: 2.1 time: 0.097712 Oct 12 04:20:58.398630 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 339/678] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:58 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:20:59.027807 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-8e78e8c7-4de4-488f-b39d-2d5b9af92257 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:59.028634 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-8e78e8c7-4de4-488f-b39d-2d5b9af92257 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:59.036447 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8e78e8c7-4de4-488f-b39d-2d5b9af92257 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:59.036896 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8e78e8c7-4de4-488f-b39d-2d5b9af92257 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:59.038011 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8e78e8c7-4de4-488f-b39d-2d5b9af92257 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:59.038622 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8e78e8c7-4de4-488f-b39d-2d5b9af92257 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:59.167536 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-8e78e8c7-4de4-488f-b39d-2d5b9af92257 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:59.175527 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-8e78e8c7-4de4-488f-b39d-2d5b9af92257 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:59.178063 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-8e78e8c7-4de4-488f-b39d-2d5b9af92257 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:20:59.179199 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-8e78e8c7-4de4-488f-b39d-2d5b9af92257 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1405 microversion: 2.20 time: 0.159566 Oct 12 04:20:59.179755 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 340/679] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:20:59 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:20:59.417582 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-6b4758ae-17a3-4942-bff6-411391206641 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:59.418096 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-6b4758ae-17a3-4942-bff6-411391206641 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:20:59.423902 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6b4758ae-17a3-4942-bff6-411391206641 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:59.424339 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6b4758ae-17a3-4942-bff6-411391206641 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:59.425091 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6b4758ae-17a3-4942-bff6-411391206641 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:20:59.425547 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6b4758ae-17a3-4942-bff6-411391206641 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:20:59.439273 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.wsgi [None req-6b4758ae-17a3-4942-bff6-411391206641 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] HTTP exception thrown: Instance bbee8a27-52f2-42c0-8cb5-bfade5bfb587 could not be found. Oct 12 04:20:59.439866 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-6b4758ae-17a3-4942-bff6-411391206641 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Returning 404 to user: Instance bbee8a27-52f2-42c0-8cb5-bfade5bfb587 could not be found. {{(pid=108898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:20:59.440662 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-6b4758ae-17a3-4942-bff6-411391206641 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 404 len: 111 microversion: 2.1 time: 0.027713 Oct 12 04:20:59.441372 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 340/680] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:20:59 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:20:59.449339 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-99dcfa28-7cd3-469a-9b97-741ff8777021 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '.version_select at 0x7f3855532670>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:20:59.569426 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-99dcfa28-7cd3-469a-9b97-741ff8777021 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-187357208" status: 202 len: 0 microversion: 2.1 time: 0.123567 Oct 12 04:20:59.572152 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 341/681] 10.222.0.21 () {58 vars in 1217 bytes} [Tue Oct 12 04:20:59 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-187357208 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:21:00.197328 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-e2e84dad-bd74-4a4c-a426-0dd83e54d68f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:00.198018 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-e2e84dad-bd74-4a4c-a426-0dd83e54d68f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:00.203623 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e2e84dad-bd74-4a4c-a426-0dd83e54d68f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:00.204064 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e2e84dad-bd74-4a4c-a426-0dd83e54d68f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:00.204862 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e2e84dad-bd74-4a4c-a426-0dd83e54d68f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:00.205286 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e2e84dad-bd74-4a4c-a426-0dd83e54d68f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:00.391895 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-b7f501be-bfc3-4a49-8541-5b9f009627e4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'create', calling method: .version_select at 0x7f3855541280>, body: {"keypair": {"name": "tempest-keypair-1011239324"}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:00.394443 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-e2e84dad-bd74-4a4c-a426-0dd83e54d68f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:00.404132 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-e2e84dad-bd74-4a4c-a426-0dd83e54d68f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:00.405944 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-e2e84dad-bd74-4a4c-a426-0dd83e54d68f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:00.407845 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-e2e84dad-bd74-4a4c-a426-0dd83e54d68f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1598 microversion: 2.20 time: 0.214420 Oct 12 04:21:00.421260 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 341/682] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:21:00 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1598 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:21:00.424027 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-b7f501be-bfc3-4a49-8541-5b9f009627e4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Getting quotas for project a99e41211e834d8aaf06b40712cb4893. Resources: {'key_pairs'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:21:00.427886 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-859f232c-7ac4-4595-92a8-7417cb99ebac tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:00.428166 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-859f232c-7ac4-4595-92a8-7417cb99ebac tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:00.430499 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-b7f501be-bfc3-4a49-8541-5b9f009627e4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Getting quotas for user 79ef9f68435646318c114003e8680611 and project a99e41211e834d8aaf06b40712cb4893. Resources: {'key_pairs'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:21:00.434804 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-859f232c-7ac4-4595-92a8-7417cb99ebac tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:00.435442 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-859f232c-7ac4-4595-92a8-7417cb99ebac tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:00.436382 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-859f232c-7ac4-4595-92a8-7417cb99ebac tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:00.437144 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-859f232c-7ac4-4595-92a8-7417cb99ebac tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:00.551680 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-859f232c-7ac4-4595-92a8-7417cb99ebac tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.128156 Oct 12 04:21:00.552513 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 342/683] 10.222.0.21 () {60 vars in 1315 bytes} [Tue Oct 12 04:21:00 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/os-interface => generated 285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:21:00.712097 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-b7f501be-bfc3-4a49-8541-5b9f009627e4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Getting quotas for project a99e41211e834d8aaf06b40712cb4893. Resources: {'key_pairs'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:21:00.715765 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-b7f501be-bfc3-4a49-8541-5b9f009627e4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Getting quotas for user 79ef9f68435646318c114003e8680611 and project a99e41211e834d8aaf06b40712cb4893. Resources: {'key_pairs'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:21:00.729947 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-b7f501be-bfc3-4a49-8541-5b9f009627e4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.342540 Oct 12 04:21:00.730739 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 342/684] 10.222.0.21 () {60 vars in 1157 bytes} [Tue Oct 12 04:21:00 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:21:01.733817 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-2ee6b822-267d-43ef-acf4-075a54f96c43 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:01.735532 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-2ee6b822-267d-43ef-acf4-075a54f96c43 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:01.744674 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2ee6b822-267d-43ef-acf4-075a54f96c43 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:01.745088 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2ee6b822-267d-43ef-acf4-075a54f96c43 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:01.747084 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2ee6b822-267d-43ef-acf4-075a54f96c43 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:01.747673 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2ee6b822-267d-43ef-acf4-075a54f96c43 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:01.755787 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-881de4d5-69ed-460c-944a-366260718da7 req-a00d000c-462c-4dd6-a6a9-338bf9ec9759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12862c4a-cd3e-4b8e-91b3-9dbe108af390", "tag": "5617efe3-71de-4588-bef7-3cd445452960"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:01.764018 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:21:01.764018 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:21:01.790434 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-881de4d5-69ed-460c-944a-366260718da7 req-a00d000c-462c-4dd6-a6a9-338bf9ec9759 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:01.791014 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-881de4d5-69ed-460c-944a-366260718da7 req-a00d000c-462c-4dd6-a6a9-338bf9ec9759 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:01.805223 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-881de4d5-69ed-460c-944a-366260718da7 req-a00d000c-462c-4dd6-a6a9-338bf9ec9759 service nova] Creating event network-changed:5617efe3-71de-4588-bef7-3cd445452960 for instance 12862c4a-cd3e-4b8e-91b3-9dbe108af390 on hv-cinder-81306 Oct 12 04:21:01.806185 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-2ee6b822-267d-43ef-acf4-075a54f96c43 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 14 microversion: 2.20 time: 0.076470 Oct 12 04:21:01.806895 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 343/685] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:01 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:21:01.811734 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-881de4d5-69ed-460c-944a-366260718da7 req-a00d000c-462c-4dd6-a6a9-338bf9ec9759 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068766 Oct 12 04:21:01.813783 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 343/686] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:21:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:21:02.822113 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-27f55fa7-d043-4b58-80b5-1e1d4eafb71e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:02.822113 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-27f55fa7-d043-4b58-80b5-1e1d4eafb71e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:02.827818 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-27f55fa7-d043-4b58-80b5-1e1d4eafb71e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:02.828581 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-27f55fa7-d043-4b58-80b5-1e1d4eafb71e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:02.829826 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-27f55fa7-d043-4b58-80b5-1e1d4eafb71e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:02.830642 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-27f55fa7-d043-4b58-80b5-1e1d4eafb71e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:02.891078 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-27f55fa7-d043-4b58-80b5-1e1d4eafb71e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 14 microversion: 2.20 time: 0.075166 Oct 12 04:21:02.894394 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 344/687] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:02 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:21:03.810612 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-9e845bd1-88d3-4887-ac30-0b1a6f591e74 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-538181275", "imageRef": "bf8c5573-3890-45dc-aec8-b1ad89136f80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "47359d39-1ce6-44f7-a02f-d9bf518e6124"}], "security_groups": [{"name": "tempest-securitygroup--1084643578"}], "key_name": "tempest-keypair-1011239324", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:03.899296 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.network.neutron [None req-9e845bd1-88d3-4887-ac30-0b1a6f591e74 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] validate_networks() for [('47359d39-1ce6-44f7-a02f-d9bf518e6124', None, None, None, None, None)] {{(pid=108897) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 04:21:03.901686 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-29bd6cd3-d795-4528-bbac-70b342a3ca8a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:03.902700 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-29bd6cd3-d795-4528-bbac-70b342a3ca8a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:03.909753 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-29bd6cd3-d795-4528-bbac-70b342a3ca8a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:03.910191 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-29bd6cd3-d795-4528-bbac-70b342a3ca8a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:03.910972 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-29bd6cd3-d795-4528-bbac-70b342a3ca8a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:03.911396 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-29bd6cd3-d795-4528-bbac-70b342a3ca8a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:04.250066 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-9e845bd1-88d3-4887-ac30-0b1a6f591e74 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Flavor limits 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 04:21:04.250489 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-9e845bd1-88d3-4887-ac30-0b1a6f591e74 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Image limits 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 04:21:04.250986 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-9e845bd1-88d3-4887-ac30-0b1a6f591e74 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Flavor pref 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 04:21:04.251390 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-9e845bd1-88d3-4887-ac30-0b1a6f591e74 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Image pref 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 04:21:04.251794 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-9e845bd1-88d3-4887-ac30-0b1a6f591e74 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 04:21:04.268074 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9e845bd1-88d3-4887-ac30-0b1a6f591e74 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:04.268074 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9e845bd1-88d3-4887-ac30-0b1a6f591e74 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:04.268074 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9e845bd1-88d3-4887-ac30-0b1a6f591e74 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:04.268074 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9e845bd1-88d3-4887-ac30-0b1a6f591e74 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:04.277892 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-9e845bd1-88d3-4887-ac30-0b1a6f591e74 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Getting quotas for project a99e41211e834d8aaf06b40712cb4893. Resources: {'cores', 'instances', 'ram'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:21:04.282302 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-9e845bd1-88d3-4887-ac30-0b1a6f591e74 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Getting quotas for user 79ef9f68435646318c114003e8680611 and project a99e41211e834d8aaf06b40712cb4893. Resources: {'cores', 'instances', 'ram'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:21:04.292789 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-9e845bd1-88d3-4887-ac30-0b1a6f591e74 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Going to run 1 instances... {{(pid=108897) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 04:21:04.295150 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-9e845bd1-88d3-4887-ac30-0b1a6f591e74 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf8c5573-3890-45dc-aec8-b1ad89136f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 04:21:04.461435 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-9e845bd1-88d3-4887-ac30-0b1a6f591e74 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.655168 Oct 12 04:21:04.462066 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 344/688] 10.222.0.21 () {60 vars in 1146 bytes} [Tue Oct 12 04:21:03 2021] POST /compute/v2.1/servers => generated 402 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 04:21:04.471732 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-f3745ed2-4e3d-4104-9e7c-54f6685c2b9e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:04.472419 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-f3745ed2-4e3d-4104-9e7c-54f6685c2b9e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:04.523468 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-f3745ed2-4e3d-4104-9e7c-54f6685c2b9e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:04.530854 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-f3745ed2-4e3d-4104-9e7c-54f6685c2b9e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9" status: 200 len: 1237 microversion: 2.1 time: 0.062607 Oct 12 04:21:04.531522 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 345/689] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:21:04 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9 => generated 1237 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:21:05.547835 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-bc617212-13db-4060-bbc4-8e44e14adcbe tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:05.548501 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-bc617212-13db-4060-bbc4-8e44e14adcbe tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:05.554501 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bc617212-13db-4060-bbc4-8e44e14adcbe tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:05.554970 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bc617212-13db-4060-bbc4-8e44e14adcbe tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:05.555723 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bc617212-13db-4060-bbc4-8e44e14adcbe tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:05.556151 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bc617212-13db-4060-bbc4-8e44e14adcbe tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:05.612609 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-bc617212-13db-4060-bbc4-8e44e14adcbe tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:05.619531 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-bc617212-13db-4060-bbc4-8e44e14adcbe tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9" status: 200 len: 1241 microversion: 2.1 time: 0.075322 Oct 12 04:21:05.620075 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 346/690] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:21:05 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:21:06.338762 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-29bd6cd3-d795-4528-bbac-70b342a3ca8a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 14 microversion: 2.20 time: 2.440823 Oct 12 04:21:06.339553 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 345/691] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:03 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 14 bytes in 2443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:21:06.636340 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-20d62cdf-2416-4216-9cd8-ecec5bacb13b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:06.636944 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-20d62cdf-2416-4216-9cd8-ecec5bacb13b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:06.642629 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-20d62cdf-2416-4216-9cd8-ecec5bacb13b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:06.643123 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-20d62cdf-2416-4216-9cd8-ecec5bacb13b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:06.643856 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-20d62cdf-2416-4216-9cd8-ecec5bacb13b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:06.644289 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-20d62cdf-2416-4216-9cd8-ecec5bacb13b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:06.705922 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-20d62cdf-2416-4216-9cd8-ecec5bacb13b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:06.713161 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-20d62cdf-2416-4216-9cd8-ecec5bacb13b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9" status: 200 len: 1233 microversion: 2.1 time: 0.080604 Oct 12 04:21:06.713708 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 347/692] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:21:06 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9 => generated 1233 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:21:07.350965 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-710123dd-b3cd-4603-bdba-3bb8d94840c7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:07.352084 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-710123dd-b3cd-4603-bdba-3bb8d94840c7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:07.358626 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-710123dd-b3cd-4603-bdba-3bb8d94840c7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:07.359098 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-710123dd-b3cd-4603-bdba-3bb8d94840c7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:07.359938 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-710123dd-b3cd-4603-bdba-3bb8d94840c7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:07.360394 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-710123dd-b3cd-4603-bdba-3bb8d94840c7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:07.418267 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-710123dd-b3cd-4603-bdba-3bb8d94840c7 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 14 microversion: 2.20 time: 0.071517 Oct 12 04:21:07.418918 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 346/693] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:07 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:21:07.731158 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-3f0f239a-61c5-4987-a728-c914781ec2c1 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:07.731928 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-3f0f239a-61c5-4987-a728-c914781ec2c1 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:07.738226 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3f0f239a-61c5-4987-a728-c914781ec2c1 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:07.738692 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3f0f239a-61c5-4987-a728-c914781ec2c1 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:07.739503 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3f0f239a-61c5-4987-a728-c914781ec2c1 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:07.739939 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3f0f239a-61c5-4987-a728-c914781ec2c1 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:07.801197 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-3f0f239a-61c5-4987-a728-c914781ec2c1 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:07.808520 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-3f0f239a-61c5-4987-a728-c914781ec2c1 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9" status: 200 len: 1295 microversion: 2.1 time: 0.081025 Oct 12 04:21:07.809142 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 348/694] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:21:07 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9 => generated 1295 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:21:08.430270 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-3ab3bb0c-67e4-49b1-9d04-ea2f331b28cd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:08.431242 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-3ab3bb0c-67e4-49b1-9d04-ea2f331b28cd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:08.437599 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3ab3bb0c-67e4-49b1-9d04-ea2f331b28cd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:08.438046 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3ab3bb0c-67e4-49b1-9d04-ea2f331b28cd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:08.438831 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3ab3bb0c-67e4-49b1-9d04-ea2f331b28cd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:08.439257 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3ab3bb0c-67e4-49b1-9d04-ea2f331b28cd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:08.826017 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-96155248-09fb-435f-87aa-4fea8a5d7c4f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:08.826628 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-96155248-09fb-435f-87aa-4fea8a5d7c4f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:08.832938 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-96155248-09fb-435f-87aa-4fea8a5d7c4f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:08.833373 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-96155248-09fb-435f-87aa-4fea8a5d7c4f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:08.834134 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-96155248-09fb-435f-87aa-4fea8a5d7c4f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:08.834632 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-96155248-09fb-435f-87aa-4fea8a5d7c4f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:08.951553 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-96155248-09fb-435f-87aa-4fea8a5d7c4f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:08.959290 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-96155248-09fb-435f-87aa-4fea8a5d7c4f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9" status: 200 len: 1363 microversion: 2.1 time: 0.136973 Oct 12 04:21:08.959843 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 349/695] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:21:08 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9 => generated 1363 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:21:09.976218 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-4bb4c16d-2bcf-4745-80df-4ef27ed11783 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:09.976853 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-4bb4c16d-2bcf-4745-80df-4ef27ed11783 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:09.983368 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4bb4c16d-2bcf-4745-80df-4ef27ed11783 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:09.983812 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4bb4c16d-2bcf-4745-80df-4ef27ed11783 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:09.984557 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4bb4c16d-2bcf-4745-80df-4ef27ed11783 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:09.984980 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4bb4c16d-2bcf-4745-80df-4ef27ed11783 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:10.100720 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-4bb4c16d-2bcf-4745-80df-4ef27ed11783 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:10.108002 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-4bb4c16d-2bcf-4745-80df-4ef27ed11783 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9" status: 200 len: 1363 microversion: 2.1 time: 0.135371 Oct 12 04:21:10.108553 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 350/696] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:21:09 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9 => generated 1363 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:21:10.853173 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-3ab3bb0c-67e4-49b1-9d04-ea2f331b28cd tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 14 microversion: 2.20 time: 2.426792 Oct 12 04:21:10.853972 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 347/697] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:08 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 14 bytes in 2429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:21:11.124256 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-fdb383d2-63fa-4291-a058-8058c1ca8140 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:11.124923 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-fdb383d2-63fa-4291-a058-8058c1ca8140 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:11.131526 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fdb383d2-63fa-4291-a058-8058c1ca8140 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:11.131972 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fdb383d2-63fa-4291-a058-8058c1ca8140 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:11.132738 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fdb383d2-63fa-4291-a058-8058c1ca8140 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:11.133251 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fdb383d2-63fa-4291-a058-8058c1ca8140 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:11.255369 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-fdb383d2-63fa-4291-a058-8058c1ca8140 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:11.269157 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-fdb383d2-63fa-4291-a058-8058c1ca8140 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9" status: 200 len: 1363 microversion: 2.1 time: 0.142957 Oct 12 04:21:11.269157 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 351/698] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:21:11 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9 => generated 1363 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:21:11.544170 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-9f8b9e28-b56e-4c7b-a899-28c0c375e545 req-a5e4c09e-3da4-4068-b687-c26072537e06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f60d1c9-289f-4fa1-a16d-41983b1e56e9", "tag": "ad2c8eae-2e0c-4e91-b413-4ab20a5ad7f2"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:11.545671 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:21:11.545671 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:21:11.554101 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-9f8b9e28-b56e-4c7b-a899-28c0c375e545 req-a5e4c09e-3da4-4068-b687-c26072537e06 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:11.554535 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-9f8b9e28-b56e-4c7b-a899-28c0c375e545 req-a5e4c09e-3da4-4068-b687-c26072537e06 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:11.572107 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-9f8b9e28-b56e-4c7b-a899-28c0c375e545 req-a5e4c09e-3da4-4068-b687-c26072537e06 service nova] Creating event network-changed:ad2c8eae-2e0c-4e91-b413-4ab20a5ad7f2 for instance 3f60d1c9-289f-4fa1-a16d-41983b1e56e9 on hv-cinder-81306 Oct 12 04:21:11.576889 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-9f8b9e28-b56e-4c7b-a899-28c0c375e545 req-a5e4c09e-3da4-4068-b687-c26072537e06 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036956 Oct 12 04:21:11.577496 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 348/699] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:21:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:21:11.864800 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-bfdd83ad-13ec-4108-abfb-53f6069695ae tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:11.866010 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-bfdd83ad-13ec-4108-abfb-53f6069695ae tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:11.872291 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bfdd83ad-13ec-4108-abfb-53f6069695ae tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:11.872806 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bfdd83ad-13ec-4108-abfb-53f6069695ae tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:11.873647 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bfdd83ad-13ec-4108-abfb-53f6069695ae tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:11.874077 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bfdd83ad-13ec-4108-abfb-53f6069695ae tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:11.933304 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-bfdd83ad-13ec-4108-abfb-53f6069695ae tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 14 microversion: 2.20 time: 0.072594 Oct 12 04:21:11.933876 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 352/700] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:11 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:21:12.281168 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-9b7a9144-0fd1-4b20-bbfc-acaa902ffa23 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:12.281894 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-9b7a9144-0fd1-4b20-bbfc-acaa902ffa23 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:12.288405 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9b7a9144-0fd1-4b20-bbfc-acaa902ffa23 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:12.288860 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9b7a9144-0fd1-4b20-bbfc-acaa902ffa23 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:12.289627 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9b7a9144-0fd1-4b20-bbfc-acaa902ffa23 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:12.290073 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9b7a9144-0fd1-4b20-bbfc-acaa902ffa23 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:12.413105 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-9b7a9144-0fd1-4b20-bbfc-acaa902ffa23 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:12.420438 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-9b7a9144-0fd1-4b20-bbfc-acaa902ffa23 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9" status: 200 len: 1363 microversion: 2.1 time: 0.143408 Oct 12 04:21:12.420991 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 349/701] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:21:12 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9 => generated 1363 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:21:12.944456 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-68398c14-48cb-4810-8a1c-b04f5610cb8b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:12.945450 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-68398c14-48cb-4810-8a1c-b04f5610cb8b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:12.951831 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-68398c14-48cb-4810-8a1c-b04f5610cb8b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:12.952282 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-68398c14-48cb-4810-8a1c-b04f5610cb8b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:12.953039 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-68398c14-48cb-4810-8a1c-b04f5610cb8b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:12.953470 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-68398c14-48cb-4810-8a1c-b04f5610cb8b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:13.024951 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-68398c14-48cb-4810-8a1c-b04f5610cb8b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 9954 microversion: 2.20 time: 0.084325 Oct 12 04:21:13.025496 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 353/702] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:12 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 9954 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:21:13.437329 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-2fcaee74-fb4a-428b-9af3-eb1111fb748e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:13.437939 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-2fcaee74-fb4a-428b-9af3-eb1111fb748e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:13.444797 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2fcaee74-fb4a-428b-9af3-eb1111fb748e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:13.445290 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2fcaee74-fb4a-428b-9af3-eb1111fb748e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:13.446061 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2fcaee74-fb4a-428b-9af3-eb1111fb748e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:13.446492 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2fcaee74-fb4a-428b-9af3-eb1111fb748e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:13.563802 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-2fcaee74-fb4a-428b-9af3-eb1111fb748e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:13.571472 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-2fcaee74-fb4a-428b-9af3-eb1111fb748e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9" status: 200 len: 1363 microversion: 2.1 time: 0.137867 Oct 12 04:21:13.572024 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 350/703] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:21:13 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9 => generated 1363 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:21:14.036795 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-2b7f3fc2-2210-4eb5-8a8a-bacf14796d24 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:14.037783 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-2b7f3fc2-2210-4eb5-8a8a-bacf14796d24 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:14.044146 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2b7f3fc2-2210-4eb5-8a8a-bacf14796d24 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:14.044594 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2b7f3fc2-2210-4eb5-8a8a-bacf14796d24 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:14.045531 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2b7f3fc2-2210-4eb5-8a8a-bacf14796d24 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:14.045766 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2b7f3fc2-2210-4eb5-8a8a-bacf14796d24 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:14.119531 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-2b7f3fc2-2210-4eb5-8a8a-bacf14796d24 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 17250 microversion: 2.20 time: 0.086998 Oct 12 04:21:14.120072 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 354/704] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:14 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 17250 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:21:14.589567 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-6c49cdf5-9e62-4d3c-adf8-3d1f640879ab tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:14.590207 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-6c49cdf5-9e62-4d3c-adf8-3d1f640879ab tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:14.596086 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6c49cdf5-9e62-4d3c-adf8-3d1f640879ab tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:14.596521 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6c49cdf5-9e62-4d3c-adf8-3d1f640879ab tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:14.597274 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6c49cdf5-9e62-4d3c-adf8-3d1f640879ab tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:14.597700 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6c49cdf5-9e62-4d3c-adf8-3d1f640879ab tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:14.716565 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-6c49cdf5-9e62-4d3c-adf8-3d1f640879ab tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:14.724424 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-6c49cdf5-9e62-4d3c-adf8-3d1f640879ab tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9" status: 200 len: 1363 microversion: 2.1 time: 0.140720 Oct 12 04:21:14.724982 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 351/705] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:21:14 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9 => generated 1363 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:21:15.132101 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-9c608e74-b901-46b0-9e22-8b9ea8dda388 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:15.133076 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-9c608e74-b901-46b0-9e22-8b9ea8dda388 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:15.139578 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9c608e74-b901-46b0-9e22-8b9ea8dda388 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:15.139956 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9c608e74-b901-46b0-9e22-8b9ea8dda388 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:15.140702 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9c608e74-b901-46b0-9e22-8b9ea8dda388 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:15.141125 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9c608e74-b901-46b0-9e22-8b9ea8dda388 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:15.206557 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-9c608e74-b901-46b0-9e22-8b9ea8dda388 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 18356 microversion: 2.20 time: 0.079080 Oct 12 04:21:15.207473 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 355/706] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:15 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 18356 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:21:15.741120 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-f4292c00-ca73-46c2-80ad-e699392ab30c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:15.741732 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-f4292c00-ca73-46c2-80ad-e699392ab30c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:15.747983 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f4292c00-ca73-46c2-80ad-e699392ab30c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:15.748505 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f4292c00-ca73-46c2-80ad-e699392ab30c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:15.749355 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f4292c00-ca73-46c2-80ad-e699392ab30c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:15.749874 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f4292c00-ca73-46c2-80ad-e699392ab30c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:15.867515 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-f4292c00-ca73-46c2-80ad-e699392ab30c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:15.874588 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-f4292c00-ca73-46c2-80ad-e699392ab30c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9" status: 200 len: 1363 microversion: 2.1 time: 0.137172 Oct 12 04:21:15.875167 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 352/707] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:21:15 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9 => generated 1363 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:21:16.218561 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-bfcbf8d5-37ea-4b3e-a4f3-53075809ac08 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:16.219581 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-bfcbf8d5-37ea-4b3e-a4f3-53075809ac08 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:16.226090 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bfcbf8d5-37ea-4b3e-a4f3-53075809ac08 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:16.226531 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bfcbf8d5-37ea-4b3e-a4f3-53075809ac08 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:16.227329 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bfcbf8d5-37ea-4b3e-a4f3-53075809ac08 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:16.227757 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bfcbf8d5-37ea-4b3e-a4f3-53075809ac08 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:16.891046 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-b1ac54c8-be21-48e4-bad9-e125a4ae64c8 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:16.891645 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-b1ac54c8-be21-48e4-bad9-e125a4ae64c8 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:16.897393 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b1ac54c8-be21-48e4-bad9-e125a4ae64c8 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:16.897833 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b1ac54c8-be21-48e4-bad9-e125a4ae64c8 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:16.898580 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b1ac54c8-be21-48e4-bad9-e125a4ae64c8 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:16.899028 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b1ac54c8-be21-48e4-bad9-e125a4ae64c8 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:17.015078 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-b1ac54c8-be21-48e4-bad9-e125a4ae64c8 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:17.022050 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-b1ac54c8-be21-48e4-bad9-e125a4ae64c8 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9" status: 200 len: 1363 microversion: 2.1 time: 0.134604 Oct 12 04:21:17.022597 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 353/708] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:21:16 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9 => generated 1363 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:21:18.038395 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-da9e1c8a-2693-4b23-a3e0-4f0e231e63fe tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:18.039023 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-da9e1c8a-2693-4b23-a3e0-4f0e231e63fe tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:18.044687 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-da9e1c8a-2693-4b23-a3e0-4f0e231e63fe tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:18.045121 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-da9e1c8a-2693-4b23-a3e0-4f0e231e63fe tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:18.045869 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-da9e1c8a-2693-4b23-a3e0-4f0e231e63fe tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:18.046291 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-da9e1c8a-2693-4b23-a3e0-4f0e231e63fe tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:18.166099 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-da9e1c8a-2693-4b23-a3e0-4f0e231e63fe tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:18.173079 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-da9e1c8a-2693-4b23-a3e0-4f0e231e63fe tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9" status: 200 len: 1363 microversion: 2.1 time: 0.138350 Oct 12 04:21:18.173628 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 354/709] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:21:18 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9 => generated 1363 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:21:18.319533 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-bfcbf8d5-37ea-4b3e-a4f3-53075809ac08 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 24181 microversion: 2.20 time: 2.104853 Oct 12 04:21:18.320220 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 356/710] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:16 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 24181 bytes in 2107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:21:19.190597 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-1240481c-e31c-4ec3-a2bc-000fe0aae2ff tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:19.191229 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-1240481c-e31c-4ec3-a2bc-000fe0aae2ff tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:19.197032 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1240481c-e31c-4ec3-a2bc-000fe0aae2ff tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:19.197476 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1240481c-e31c-4ec3-a2bc-000fe0aae2ff tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:19.198233 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1240481c-e31c-4ec3-a2bc-000fe0aae2ff tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:19.198679 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1240481c-e31c-4ec3-a2bc-000fe0aae2ff tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:19.316514 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-1240481c-e31c-4ec3-a2bc-000fe0aae2ff tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:19.323533 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-1240481c-e31c-4ec3-a2bc-000fe0aae2ff tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9" status: 200 len: 1363 microversion: 2.1 time: 0.137068 Oct 12 04:21:19.324087 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 355/711] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:21:19 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9 => generated 1363 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:21:19.331992 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-800784b3-2e79-4224-ab1b-fae70b165e78 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:19.332975 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-800784b3-2e79-4224-ab1b-fae70b165e78 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:19.339387 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-800784b3-2e79-4224-ab1b-fae70b165e78 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:19.339826 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-800784b3-2e79-4224-ab1b-fae70b165e78 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:19.340624 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-800784b3-2e79-4224-ab1b-fae70b165e78 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:19.341023 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-800784b3-2e79-4224-ab1b-fae70b165e78 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:19.410858 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-800784b3-2e79-4224-ab1b-fae70b165e78 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 25675 microversion: 2.20 time: 0.083154 Oct 12 04:21:19.411514 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 357/712] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:19 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 25675 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:21:20.339758 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-aca2da8f-4649-4f0a-a67a-9d476c73829a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:20.340381 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-aca2da8f-4649-4f0a-a67a-9d476c73829a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:20.346586 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-aca2da8f-4649-4f0a-a67a-9d476c73829a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:20.347091 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-aca2da8f-4649-4f0a-a67a-9d476c73829a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:20.348399 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-aca2da8f-4649-4f0a-a67a-9d476c73829a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:20.348825 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-aca2da8f-4649-4f0a-a67a-9d476c73829a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:20.421859 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-0691d618-7a4a-42ac-a86f-5b2ff61c0a73 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:20.426693 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-0691d618-7a4a-42ac-a86f-5b2ff61c0a73 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:20.430991 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0691d618-7a4a-42ac-a86f-5b2ff61c0a73 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:20.432276 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0691d618-7a4a-42ac-a86f-5b2ff61c0a73 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:20.433735 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0691d618-7a4a-42ac-a86f-5b2ff61c0a73 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:20.434236 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0691d618-7a4a-42ac-a86f-5b2ff61c0a73 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:20.477985 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-aca2da8f-4649-4f0a-a67a-9d476c73829a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:20.486554 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-aca2da8f-4649-4f0a-a67a-9d476c73829a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9" status: 200 len: 1363 microversion: 2.1 time: 0.150442 Oct 12 04:21:20.490709 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 356/713] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:21:20 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:21:20.522887 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-0691d618-7a4a-42ac-a86f-5b2ff61c0a73 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 27013 microversion: 2.20 time: 0.104860 Oct 12 04:21:20.523817 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 358/714] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:20 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 27013 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 04:21:20.551456 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-05e8a23b-64af-4b94-b534-01cab84a4d13 req-3440c03b-8f73-43f6-a971-f9215fbb614b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f60d1c9-289f-4fa1-a16d-41983b1e56e9", "name": "network-vif-plugged", "status": "completed", "tag": "ad2c8eae-2e0c-4e91-b413-4ab20a5ad7f2"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:20.553544 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:21:20.553544 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:21:20.560812 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-05e8a23b-64af-4b94-b534-01cab84a4d13 req-3440c03b-8f73-43f6-a971-f9215fbb614b service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:20.561443 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-05e8a23b-64af-4b94-b534-01cab84a4d13 req-3440c03b-8f73-43f6-a971-f9215fbb614b service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:20.574219 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-05e8a23b-64af-4b94-b534-01cab84a4d13 req-3440c03b-8f73-43f6-a971-f9215fbb614b service nova] Creating event network-vif-plugged:ad2c8eae-2e0c-4e91-b413-4ab20a5ad7f2 for instance 3f60d1c9-289f-4fa1-a16d-41983b1e56e9 on hv-cinder-81306 Oct 12 04:21:20.579301 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-05e8a23b-64af-4b94-b534-01cab84a4d13 req-3440c03b-8f73-43f6-a971-f9215fbb614b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031868 Oct 12 04:21:20.579890 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 357/715] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:21:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:21:21.504118 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-040a99ad-2d62-4659-9451-f6e29e42fb4e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:21.504921 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-040a99ad-2d62-4659-9451-f6e29e42fb4e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:21.511459 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-040a99ad-2d62-4659-9451-f6e29e42fb4e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:21.511925 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-040a99ad-2d62-4659-9451-f6e29e42fb4e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:21.512686 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-040a99ad-2d62-4659-9451-f6e29e42fb4e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:21.513117 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-040a99ad-2d62-4659-9451-f6e29e42fb4e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:21.535393 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-6b5fb0f3-9633-4eb4-8b64-17bd307d6cd6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:21.536387 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-6b5fb0f3-9633-4eb4-8b64-17bd307d6cd6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:21.542426 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6b5fb0f3-9633-4eb4-8b64-17bd307d6cd6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:21.542920 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6b5fb0f3-9633-4eb4-8b64-17bd307d6cd6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:21.543681 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6b5fb0f3-9633-4eb4-8b64-17bd307d6cd6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:21.544107 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6b5fb0f3-9633-4eb4-8b64-17bd307d6cd6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:21.619098 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-6b5fb0f3-9633-4eb4-8b64-17bd307d6cd6 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 27689 microversion: 2.20 time: 0.088071 Oct 12 04:21:21.624794 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 358/716] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:21 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 27689 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 04:21:21.637866 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-040a99ad-2d62-4659-9451-f6e29e42fb4e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:21.645541 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-040a99ad-2d62-4659-9451-f6e29e42fb4e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9" status: 200 len: 1363 microversion: 2.1 time: 0.145537 Oct 12 04:21:21.646089 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 359/717] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:21:21 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:21:22.632013 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-21c36a26-2038-4202-a278-9487078e5d00 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:22.632916 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-21c36a26-2038-4202-a278-9487078e5d00 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:22.641852 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-21c36a26-2038-4202-a278-9487078e5d00 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:22.641852 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-21c36a26-2038-4202-a278-9487078e5d00 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:22.641852 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-21c36a26-2038-4202-a278-9487078e5d00 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:22.641852 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-21c36a26-2038-4202-a278-9487078e5d00 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:22.662684 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-b90b066d-5217-4e89-9090-bd9e04692321 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:22.663499 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-b90b066d-5217-4e89-9090-bd9e04692321 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:22.671376 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b90b066d-5217-4e89-9090-bd9e04692321 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:22.671376 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b90b066d-5217-4e89-9090-bd9e04692321 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:22.671376 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b90b066d-5217-4e89-9090-bd9e04692321 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:22.671376 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b90b066d-5217-4e89-9090-bd9e04692321 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:22.717869 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-21c36a26-2038-4202-a278-9487078e5d00 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 28075 microversion: 2.20 time: 0.090366 Oct 12 04:21:22.721767 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 359/718] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:22 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 28075 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:21:22.792073 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-b90b066d-5217-4e89-9090-bd9e04692321 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:22.799103 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-b90b066d-5217-4e89-9090-bd9e04692321 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9" status: 200 len: 1548 microversion: 2.1 time: 0.140311 Oct 12 04:21:22.799657 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 360/719] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:21:22 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9 => generated 1548 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:21:22.816524 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-5a080917-41df-4de8-aaa1-c44fb9318c44 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:22.817151 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-5a080917-41df-4de8-aaa1-c44fb9318c44 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:22.823705 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5a080917-41df-4de8-aaa1-c44fb9318c44 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:22.827304 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5a080917-41df-4de8-aaa1-c44fb9318c44 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:22.827304 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5a080917-41df-4de8-aaa1-c44fb9318c44 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:22.827304 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5a080917-41df-4de8-aaa1-c44fb9318c44 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:22.904312 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-5a080917-41df-4de8-aaa1-c44fb9318c44 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091972 Oct 12 04:21:22.904894 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 360/720] 10.222.0.21 () {58 vars in 1274 bytes} [Tue Oct 12 04:21:22 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:21:23.729645 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-6a6f1196-e0d4-4003-b1d9-162a3c62918d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:23.735975 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-6a6f1196-e0d4-4003-b1d9-162a3c62918d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:23.741788 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6a6f1196-e0d4-4003-b1d9-162a3c62918d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:23.742239 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6a6f1196-e0d4-4003-b1d9-162a3c62918d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:23.743039 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6a6f1196-e0d4-4003-b1d9-162a3c62918d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:23.743476 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6a6f1196-e0d4-4003-b1d9-162a3c62918d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:23.829307 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-6a6f1196-e0d4-4003-b1d9-162a3c62918d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 28217 microversion: 2.20 time: 0.103439 Oct 12 04:21:23.830886 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 361/721] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:23 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 28217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:21:23.878182 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-753f0512-88c8-4c88-b9a5-2672ac7ab72b req-f5c42e96-2737-4fd6-91f9-3bf8e44ba269 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f60d1c9-289f-4fa1-a16d-41983b1e56e9", "tag": "ad2c8eae-2e0c-4e91-b413-4ab20a5ad7f2"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:23.880188 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:21:23.880188 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:21:23.884742 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-5ff05792-c4c1-4414-afec-2f12f6433b2a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:23.885656 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-5ff05792-c4c1-4414-afec-2f12f6433b2a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:23.893504 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5ff05792-c4c1-4414-afec-2f12f6433b2a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:23.894005 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5ff05792-c4c1-4414-afec-2f12f6433b2a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:23.894833 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5ff05792-c4c1-4414-afec-2f12f6433b2a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:23.895261 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5ff05792-c4c1-4414-afec-2f12f6433b2a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:23.899684 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-753f0512-88c8-4c88-b9a5-2672ac7ab72b req-f5c42e96-2737-4fd6-91f9-3bf8e44ba269 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:23.900121 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-753f0512-88c8-4c88-b9a5-2672ac7ab72b req-f5c42e96-2737-4fd6-91f9-3bf8e44ba269 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:23.911545 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-753f0512-88c8-4c88-b9a5-2672ac7ab72b req-f5c42e96-2737-4fd6-91f9-3bf8e44ba269 service nova] Creating event network-changed:ad2c8eae-2e0c-4e91-b413-4ab20a5ad7f2 for instance 3f60d1c9-289f-4fa1-a16d-41983b1e56e9 on hv-cinder-81306 Oct 12 04:21:23.916689 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-753f0512-88c8-4c88-b9a5-2672ac7ab72b req-f5c42e96-2737-4fd6-91f9-3bf8e44ba269 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043025 Oct 12 04:21:23.917501 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 362/722] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:21:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:21:23.959805 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-5ff05792-c4c1-4414-afec-2f12f6433b2a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 14 microversion: 2.1 time: 0.090331 Oct 12 04:21:23.960656 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 361/723] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:23 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 04:21:24.841978 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-1e1bff06-9606-497b-92b5-532d22830415 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:24.846317 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-1e1bff06-9606-497b-92b5-532d22830415 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:24.849857 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1e1bff06-9606-497b-92b5-532d22830415 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:24.850305 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1e1bff06-9606-497b-92b5-532d22830415 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:24.851162 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1e1bff06-9606-497b-92b5-532d22830415 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:24.851592 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1e1bff06-9606-497b-92b5-532d22830415 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:24.925268 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-1e1bff06-9606-497b-92b5-532d22830415 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 28508 microversion: 2.20 time: 0.087237 Oct 12 04:21:24.929122 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 363/724] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:24 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 28508 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:21:24.972862 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-40baf998-e837-48c5-9fed-669b9d72d6c9 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:24.973854 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-40baf998-e837-48c5-9fed-669b9d72d6c9 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:24.980275 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-40baf998-e837-48c5-9fed-669b9d72d6c9 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:24.980725 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-40baf998-e837-48c5-9fed-669b9d72d6c9 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:24.981481 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-40baf998-e837-48c5-9fed-669b9d72d6c9 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:24.982154 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-40baf998-e837-48c5-9fed-669b9d72d6c9 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:25.048346 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-40baf998-e837-48c5-9fed-669b9d72d6c9 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 14 microversion: 2.1 time: 0.081182 Oct 12 04:21:25.052238 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 362/725] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:24 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 04:21:25.937374 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-6cb7b966-e45b-4050-b05a-459f56374563 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:25.938364 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-6cb7b966-e45b-4050-b05a-459f56374563 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:25.945251 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6cb7b966-e45b-4050-b05a-459f56374563 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:25.945696 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6cb7b966-e45b-4050-b05a-459f56374563 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:25.946459 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6cb7b966-e45b-4050-b05a-459f56374563 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:25.946917 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6cb7b966-e45b-4050-b05a-459f56374563 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:26.022044 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-6cb7b966-e45b-4050-b05a-459f56374563 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 28676 microversion: 2.20 time: 0.088585 Oct 12 04:21:26.026056 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 364/726] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:25 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 28676 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:21:26.059825 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-ee4430b4-406b-4143-bdad-27f504de2abc tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:26.060808 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-ee4430b4-406b-4143-bdad-27f504de2abc tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:26.069331 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ee4430b4-406b-4143-bdad-27f504de2abc tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:26.069772 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ee4430b4-406b-4143-bdad-27f504de2abc tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:26.070542 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ee4430b4-406b-4143-bdad-27f504de2abc tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:26.071012 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ee4430b4-406b-4143-bdad-27f504de2abc tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:26.130358 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-ee4430b4-406b-4143-bdad-27f504de2abc tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 14 microversion: 2.1 time: 0.074286 Oct 12 04:21:26.133610 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 363/727] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:26 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 04:21:27.033442 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-48a38290-11a2-4a63-b222-bc7c2e37d767 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:27.034567 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-48a38290-11a2-4a63-b222-bc7c2e37d767 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:27.040881 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-48a38290-11a2-4a63-b222-bc7c2e37d767 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:27.041331 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-48a38290-11a2-4a63-b222-bc7c2e37d767 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:27.042102 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-48a38290-11a2-4a63-b222-bc7c2e37d767 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:27.042530 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-48a38290-11a2-4a63-b222-bc7c2e37d767 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:27.104329 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-48a38290-11a2-4a63-b222-bc7c2e37d767 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 28676 microversion: 2.20 time: 0.074637 Oct 12 04:21:27.108778 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 365/728] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:27 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 28676 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:21:27.141821 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-f1917b3f-3c24-4ea8-9d04-8019f95a61ce tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:27.142839 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-f1917b3f-3c24-4ea8-9d04-8019f95a61ce tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:27.150792 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f1917b3f-3c24-4ea8-9d04-8019f95a61ce tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:27.150792 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f1917b3f-3c24-4ea8-9d04-8019f95a61ce tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:27.150792 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f1917b3f-3c24-4ea8-9d04-8019f95a61ce tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:27.151284 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f1917b3f-3c24-4ea8-9d04-8019f95a61ce tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:27.243718 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-f1917b3f-3c24-4ea8-9d04-8019f95a61ce tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 14 microversion: 2.1 time: 0.105661 Oct 12 04:21:27.244439 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 364/729] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:27 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 04:21:28.116220 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-977593af-59d7-4950-8384-09478564dff8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:28.117265 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-977593af-59d7-4950-8384-09478564dff8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:28.123851 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-977593af-59d7-4950-8384-09478564dff8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:28.124334 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-977593af-59d7-4950-8384-09478564dff8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:28.125105 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-977593af-59d7-4950-8384-09478564dff8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:28.125534 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-977593af-59d7-4950-8384-09478564dff8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:28.187563 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-977593af-59d7-4950-8384-09478564dff8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 28676 microversion: 2.20 time: 0.075321 Oct 12 04:21:28.188237 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 366/730] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:28 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 28676 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:21:28.255412 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d705eb0a-0032-439f-9407-e21d6f9d8640 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:28.256406 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-d705eb0a-0032-439f-9407-e21d6f9d8640 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:28.263160 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d705eb0a-0032-439f-9407-e21d6f9d8640 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:28.263602 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d705eb0a-0032-439f-9407-e21d6f9d8640 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:28.264573 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d705eb0a-0032-439f-9407-e21d6f9d8640 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:28.265006 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d705eb0a-0032-439f-9407-e21d6f9d8640 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:28.330645 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-d705eb0a-0032-439f-9407-e21d6f9d8640 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 14 microversion: 2.1 time: 0.079618 Oct 12 04:21:28.331968 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 365/731] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:28 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 04:21:29.200901 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-2b2e5a6a-2daa-4bb9-8fb5-0e11ebe17763 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:29.201919 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-2b2e5a6a-2daa-4bb9-8fb5-0e11ebe17763 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:29.208458 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2b2e5a6a-2daa-4bb9-8fb5-0e11ebe17763 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:29.208904 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2b2e5a6a-2daa-4bb9-8fb5-0e11ebe17763 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:29.209666 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2b2e5a6a-2daa-4bb9-8fb5-0e11ebe17763 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:29.210096 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2b2e5a6a-2daa-4bb9-8fb5-0e11ebe17763 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:29.280489 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-2b2e5a6a-2daa-4bb9-8fb5-0e11ebe17763 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 28676 microversion: 2.20 time: 0.083493 Oct 12 04:21:29.281069 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 367/732] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:29 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 28676 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:21:29.341943 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-59fe141a-4c47-4dd4-a0b9-35fa003c5660 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:29.342979 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-59fe141a-4c47-4dd4-a0b9-35fa003c5660 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:29.349652 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-59fe141a-4c47-4dd4-a0b9-35fa003c5660 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:29.350104 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-59fe141a-4c47-4dd4-a0b9-35fa003c5660 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:29.350921 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-59fe141a-4c47-4dd4-a0b9-35fa003c5660 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:29.351543 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-59fe141a-4c47-4dd4-a0b9-35fa003c5660 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:29.414298 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-59fe141a-4c47-4dd4-a0b9-35fa003c5660 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 14 microversion: 2.1 time: 0.076225 Oct 12 04:21:29.417538 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 366/733] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:29 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 04:21:30.293497 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-17f61795-c965-4852-abcc-c25bf2e8c0d4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:30.294996 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-17f61795-c965-4852-abcc-c25bf2e8c0d4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:30.300957 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-17f61795-c965-4852-abcc-c25bf2e8c0d4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:30.301561 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-17f61795-c965-4852-abcc-c25bf2e8c0d4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:30.302498 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-17f61795-c965-4852-abcc-c25bf2e8c0d4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:30.302950 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-17f61795-c965-4852-abcc-c25bf2e8c0d4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:30.376033 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-17f61795-c965-4852-abcc-c25bf2e8c0d4 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 30509 microversion: 2.20 time: 0.086920 Oct 12 04:21:30.376709 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 368/734] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:30 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 30509 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:21:30.425397 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-0a175928-e9d3-4890-98c8-9362aafe12f4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:30.426515 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-0a175928-e9d3-4890-98c8-9362aafe12f4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:30.432901 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0a175928-e9d3-4890-98c8-9362aafe12f4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:30.433433 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0a175928-e9d3-4890-98c8-9362aafe12f4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:30.434255 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0a175928-e9d3-4890-98c8-9362aafe12f4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:30.434714 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0a175928-e9d3-4890-98c8-9362aafe12f4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:30.492955 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-0a175928-e9d3-4890-98c8-9362aafe12f4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 14 microversion: 2.1 time: 0.071409 Oct 12 04:21:30.496280 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 367/735] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:30 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 04:21:31.389925 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-083e9fdc-d974-4de1-97d2-2cfdeedf780b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:31.391715 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-083e9fdc-d974-4de1-97d2-2cfdeedf780b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:31.404034 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-083e9fdc-d974-4de1-97d2-2cfdeedf780b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:31.404690 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-083e9fdc-d974-4de1-97d2-2cfdeedf780b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:31.409069 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-083e9fdc-d974-4de1-97d2-2cfdeedf780b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:31.409680 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-083e9fdc-d974-4de1-97d2-2cfdeedf780b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:31.496420 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-083e9fdc-d974-4de1-97d2-2cfdeedf780b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 32540 microversion: 2.20 time: 0.111012 Oct 12 04:21:31.499771 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 369/736] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:31 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 32540 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:21:31.510030 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-a49b7d29-f742-4f6d-9855-505059852d72 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:31.511794 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-a49b7d29-f742-4f6d-9855-505059852d72 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:31.520444 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a49b7d29-f742-4f6d-9855-505059852d72 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:31.521170 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a49b7d29-f742-4f6d-9855-505059852d72 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:31.522163 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a49b7d29-f742-4f6d-9855-505059852d72 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:31.522690 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a49b7d29-f742-4f6d-9855-505059852d72 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:31.582746 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-a49b7d29-f742-4f6d-9855-505059852d72 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 14 microversion: 2.1 time: 0.076731 Oct 12 04:21:31.583525 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 368/737] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:31 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 04:21:32.510250 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-f9622cf4-2a75-460c-9b3d-29bcdd5e5084 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:32.511338 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-f9622cf4-2a75-460c-9b3d-29bcdd5e5084 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:32.517891 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f9622cf4-2a75-460c-9b3d-29bcdd5e5084 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:32.518457 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f9622cf4-2a75-460c-9b3d-29bcdd5e5084 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:32.519634 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f9622cf4-2a75-460c-9b3d-29bcdd5e5084 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:32.520189 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f9622cf4-2a75-460c-9b3d-29bcdd5e5084 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:32.594470 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-4df74f5c-5710-48c3-85d7-64909785a631 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:32.595285 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-f9622cf4-2a75-460c-9b3d-29bcdd5e5084 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 33711 microversion: 2.20 time: 0.088970 Oct 12 04:21:32.595730 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-4df74f5c-5710-48c3-85d7-64909785a631 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:32.596533 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 370/738] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:32 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 33711 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 12 04:21:32.603358 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4df74f5c-5710-48c3-85d7-64909785a631 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:32.603899 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4df74f5c-5710-48c3-85d7-64909785a631 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:32.604769 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4df74f5c-5710-48c3-85d7-64909785a631 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:32.605595 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4df74f5c-5710-48c3-85d7-64909785a631 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:32.665224 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-4df74f5c-5710-48c3-85d7-64909785a631 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 14 microversion: 2.1 time: 0.074870 Oct 12 04:21:32.665863 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 369/739] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:32 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 04:21:33.609209 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-813947f8-4e44-4b53-a887-f2594c790243 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:33.610807 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-813947f8-4e44-4b53-a887-f2594c790243 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:33.620169 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-813947f8-4e44-4b53-a887-f2594c790243 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:33.627340 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-813947f8-4e44-4b53-a887-f2594c790243 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:33.631585 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-813947f8-4e44-4b53-a887-f2594c790243 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:33.632142 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-813947f8-4e44-4b53-a887-f2594c790243 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:33.679232 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-5736cef2-bd1d-4b01-849d-3a60359c7173 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:33.681237 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-5736cef2-bd1d-4b01-849d-3a60359c7173 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:33.696608 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5736cef2-bd1d-4b01-849d-3a60359c7173 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:33.697339 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5736cef2-bd1d-4b01-849d-3a60359c7173 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:33.698473 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5736cef2-bd1d-4b01-849d-3a60359c7173 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:33.698864 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5736cef2-bd1d-4b01-849d-3a60359c7173 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:33.731451 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-813947f8-4e44-4b53-a887-f2594c790243 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 34841 microversion: 2.20 time: 0.127437 Oct 12 04:21:33.732790 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 371/740] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:33 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 34841 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:21:33.784529 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-5736cef2-bd1d-4b01-849d-3a60359c7173 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 14 microversion: 2.1 time: 0.109397 Oct 12 04:21:33.789422 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 370/741] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:33 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 04:21:34.744623 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-d199f4f4-b0e8-4039-9408-c89126c6b881 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:34.746257 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-d199f4f4-b0e8-4039-9408-c89126c6b881 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:34.752818 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d199f4f4-b0e8-4039-9408-c89126c6b881 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:34.754123 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d199f4f4-b0e8-4039-9408-c89126c6b881 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:34.755224 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d199f4f4-b0e8-4039-9408-c89126c6b881 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:34.755740 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d199f4f4-b0e8-4039-9408-c89126c6b881 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:34.797551 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-a198d9ef-4715-4043-bd7b-a5485fad36b5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:34.798571 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-a198d9ef-4715-4043-bd7b-a5485fad36b5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:34.806058 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a198d9ef-4715-4043-bd7b-a5485fad36b5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:34.806768 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a198d9ef-4715-4043-bd7b-a5485fad36b5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:34.807704 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a198d9ef-4715-4043-bd7b-a5485fad36b5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:34.808285 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a198d9ef-4715-4043-bd7b-a5485fad36b5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:34.841270 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-d199f4f4-b0e8-4039-9408-c89126c6b881 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 35833 microversion: 2.20 time: 0.100648 Oct 12 04:21:34.842069 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 372/742] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:34 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 35833 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:21:34.904307 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-a198d9ef-4715-4043-bd7b-a5485fad36b5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 11132 microversion: 2.1 time: 0.111284 Oct 12 04:21:34.905357 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 371/743] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:34 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 11132 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 04:21:35.854710 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-5afdf957-3986-49b5-b1d3-7f79986da84e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:35.856373 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-5afdf957-3986-49b5-b1d3-7f79986da84e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:35.863108 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5afdf957-3986-49b5-b1d3-7f79986da84e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:35.864072 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5afdf957-3986-49b5-b1d3-7f79986da84e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:35.864859 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5afdf957-3986-49b5-b1d3-7f79986da84e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:35.865293 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5afdf957-3986-49b5-b1d3-7f79986da84e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:35.916375 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-ab02af7c-ea6e-4d17-b526-61e211bf0a5c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:35.917368 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-ab02af7c-ea6e-4d17-b526-61e211bf0a5c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:35.924053 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ab02af7c-ea6e-4d17-b526-61e211bf0a5c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:35.924494 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ab02af7c-ea6e-4d17-b526-61e211bf0a5c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:35.925514 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ab02af7c-ea6e-4d17-b526-61e211bf0a5c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:35.925979 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ab02af7c-ea6e-4d17-b526-61e211bf0a5c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:35.936045 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-5afdf957-3986-49b5-b1d3-7f79986da84e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 37405 microversion: 2.20 time: 0.085536 Oct 12 04:21:35.936815 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 373/744] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:35 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 37405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:21:36.010299 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-ab02af7c-ea6e-4d17-b526-61e211bf0a5c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 17960 microversion: 2.1 time: 0.097719 Oct 12 04:21:36.014183 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 372/745] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:35 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 17960 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 04:21:36.951008 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-c9d79d6e-d241-4760-9832-858315d4cbc2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:36.953690 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-c9d79d6e-d241-4760-9832-858315d4cbc2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:36.961409 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c9d79d6e-d241-4760-9832-858315d4cbc2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:36.961940 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c9d79d6e-d241-4760-9832-858315d4cbc2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:36.962826 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c9d79d6e-d241-4760-9832-858315d4cbc2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:36.963848 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c9d79d6e-d241-4760-9832-858315d4cbc2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:37.024793 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-f03baa60-cee3-45a6-afd6-5d354c5453cb tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:37.026604 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-f03baa60-cee3-45a6-afd6-5d354c5453cb tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:37.034043 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f03baa60-cee3-45a6-afd6-5d354c5453cb tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:37.035112 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f03baa60-cee3-45a6-afd6-5d354c5453cb tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:37.035919 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f03baa60-cee3-45a6-afd6-5d354c5453cb tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:37.036350 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f03baa60-cee3-45a6-afd6-5d354c5453cb tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:37.055714 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-c9d79d6e-d241-4760-9832-858315d4cbc2 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 38235 microversion: 2.20 time: 0.110508 Oct 12 04:21:37.057334 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 374/746] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:36 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 38235 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:21:37.119186 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-f03baa60-cee3-45a6-afd6-5d354c5453cb tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 18915 microversion: 2.1 time: 0.095717 Oct 12 04:21:37.119186 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 373/747] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:37 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 18915 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:21:37.390823 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-28dab814-c968-4b9d-8039-18c03317ba99 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Action: 'create', calling method: .version_select at 0x7f38554ff670>, body: {"keypair": {"name": "tempest-TestShelveInstance-1444809609"}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:37.411898 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-28dab814-c968-4b9d-8039-18c03317ba99 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Getting quotas for project 06a5619d6cc54f8cb1261bb15c0fa58a. Resources: {'key_pairs'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:21:37.415790 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-28dab814-c968-4b9d-8039-18c03317ba99 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Getting quotas for user 69fefb7c10a94985a659a180ca85d560 and project 06a5619d6cc54f8cb1261bb15c0fa58a. Resources: {'key_pairs'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:21:37.679579 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-28dab814-c968-4b9d-8039-18c03317ba99 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Getting quotas for project 06a5619d6cc54f8cb1261bb15c0fa58a. Resources: {'key_pairs'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:21:37.683389 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-28dab814-c968-4b9d-8039-18c03317ba99 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Getting quotas for user 69fefb7c10a94985a659a180ca85d560 and project 06a5619d6cc54f8cb1261bb15c0fa58a. Resources: {'key_pairs'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:21:37.696423 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-28dab814-c968-4b9d-8039-18c03317ba99 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.476216 Oct 12 04:21:37.697016 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 375/748] 10.222.0.21 () {60 vars in 1157 bytes} [Tue Oct 12 04:21:37 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:21:38.073735 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-6322f7c4-1a5c-4970-bc8f-7560ed6e9a5f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:38.073735 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-6322f7c4-1a5c-4970-bc8f-7560ed6e9a5f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:38.076344 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6322f7c4-1a5c-4970-bc8f-7560ed6e9a5f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:38.076785 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6322f7c4-1a5c-4970-bc8f-7560ed6e9a5f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:38.077672 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6322f7c4-1a5c-4970-bc8f-7560ed6e9a5f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:38.078105 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6322f7c4-1a5c-4970-bc8f-7560ed6e9a5f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:38.125390 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-0e4c55f2-8efb-4afe-b1c8-db7723ca9edd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:38.126439 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-0e4c55f2-8efb-4afe-b1c8-db7723ca9edd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:38.134033 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0e4c55f2-8efb-4afe-b1c8-db7723ca9edd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:38.134483 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0e4c55f2-8efb-4afe-b1c8-db7723ca9edd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:38.135286 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0e4c55f2-8efb-4afe-b1c8-db7723ca9edd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:38.135722 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0e4c55f2-8efb-4afe-b1c8-db7723ca9edd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:38.140999 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-6322f7c4-1a5c-4970-bc8f-7560ed6e9a5f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 38235 microversion: 2.20 time: 0.076527 Oct 12 04:21:38.142533 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 374/749] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:38 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 38235 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:21:38.209368 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-0e4c55f2-8efb-4afe-b1c8-db7723ca9edd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 21463 microversion: 2.1 time: 0.087544 Oct 12 04:21:38.210047 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 376/750] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:38 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 21463 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 04:21:39.152478 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-37d40f55-15cd-404b-a379-843211ab3cee tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:39.154171 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-37d40f55-15cd-404b-a379-843211ab3cee tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:39.165075 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-37d40f55-15cd-404b-a379-843211ab3cee tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:39.168823 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-37d40f55-15cd-404b-a379-843211ab3cee tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:39.169836 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-37d40f55-15cd-404b-a379-843211ab3cee tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:39.170425 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-37d40f55-15cd-404b-a379-843211ab3cee tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:39.221229 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-155d2f3b-851c-459e-ba29-7efb1e6520cb tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:39.223607 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-155d2f3b-851c-459e-ba29-7efb1e6520cb tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:39.229995 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-155d2f3b-851c-459e-ba29-7efb1e6520cb tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:39.230442 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-155d2f3b-851c-459e-ba29-7efb1e6520cb tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:39.231241 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-155d2f3b-851c-459e-ba29-7efb1e6520cb tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:39.231678 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-155d2f3b-851c-459e-ba29-7efb1e6520cb tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:39.253477 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-37d40f55-15cd-404b-a379-843211ab3cee tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 38235 microversion: 2.20 time: 0.104733 Oct 12 04:21:39.258863 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 375/751] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:39 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 38235 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:21:39.306511 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-155d2f3b-851c-459e-ba29-7efb1e6520cb tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 23188 microversion: 2.1 time: 0.088579 Oct 12 04:21:39.307078 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 377/752] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:39 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 23188 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 04:21:40.276658 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-696bfaa0-8aa4-4565-b167-6d43c3b5178e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:40.277775 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-696bfaa0-8aa4-4565-b167-6d43c3b5178e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:40.284880 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-696bfaa0-8aa4-4565-b167-6d43c3b5178e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:40.285610 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-696bfaa0-8aa4-4565-b167-6d43c3b5178e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:40.286458 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-696bfaa0-8aa4-4565-b167-6d43c3b5178e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:40.286966 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-696bfaa0-8aa4-4565-b167-6d43c3b5178e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:40.319926 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-6dac19cb-a17b-41b3-bce2-cd824ed70c20 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:40.320994 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-6dac19cb-a17b-41b3-bce2-cd824ed70c20 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:40.327493 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6dac19cb-a17b-41b3-bce2-cd824ed70c20 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:40.327965 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6dac19cb-a17b-41b3-bce2-cd824ed70c20 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:40.328740 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6dac19cb-a17b-41b3-bce2-cd824ed70c20 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:40.329172 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6dac19cb-a17b-41b3-bce2-cd824ed70c20 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:40.358987 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-696bfaa0-8aa4-4565-b167-6d43c3b5178e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 38244 microversion: 2.20 time: 0.092906 Oct 12 04:21:40.360137 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 376/753] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:40 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 38244 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:21:40.402058 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-6dac19cb-a17b-41b3-bce2-cd824ed70c20 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 24727 microversion: 2.1 time: 0.088031 Oct 12 04:21:40.406067 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 378/754] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:40 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 24727 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 04:21:41.372784 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-ff5f3954-7752-480d-9bc9-0700641d1f31 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:41.373882 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-ff5f3954-7752-480d-9bc9-0700641d1f31 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:41.380379 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ff5f3954-7752-480d-9bc9-0700641d1f31 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:41.380845 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ff5f3954-7752-480d-9bc9-0700641d1f31 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:41.381784 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ff5f3954-7752-480d-9bc9-0700641d1f31 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:41.382344 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ff5f3954-7752-480d-9bc9-0700641d1f31 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:41.414431 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-174a4712-eb37-49e3-904e-5fa0124f3e66 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:41.415439 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-174a4712-eb37-49e3-904e-5fa0124f3e66 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:41.421847 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-174a4712-eb37-49e3-904e-5fa0124f3e66 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:41.422292 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-174a4712-eb37-49e3-904e-5fa0124f3e66 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:41.423090 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-174a4712-eb37-49e3-904e-5fa0124f3e66 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:41.423525 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-174a4712-eb37-49e3-904e-5fa0124f3e66 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:41.458543 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-ff5f3954-7752-480d-9bc9-0700641d1f31 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 200 len: 38378 microversion: 2.20 time: 0.090167 Oct 12 04:21:41.459881 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 377/755] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:41 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 38378 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:21:41.469295 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-5b0ee49c-027e-4480-904d-795224c1ceea tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:41.469893 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-5b0ee49c-027e-4480-904d-795224c1ceea tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:41.476944 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5b0ee49c-027e-4480-904d-795224c1ceea tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:41.477322 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5b0ee49c-027e-4480-904d-795224c1ceea tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:41.478072 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5b0ee49c-027e-4480-904d-795224c1ceea tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:41.478495 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5b0ee49c-027e-4480-904d-795224c1ceea tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:41.500543 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-5b0ee49c-027e-4480-904d-795224c1ceea tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/ips" status: 200 len: 152 microversion: 2.20 time: 0.035005 Oct 12 04:21:41.500994 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 378/756] 10.222.0.21 () {60 vars in 1288 bytes} [Tue Oct 12 04:21:41 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/ips => generated 152 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 04:21:41.505430 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-174a4712-eb37-49e3-904e-5fa0124f3e66 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 26378 microversion: 2.1 time: 0.094856 Oct 12 04:21:41.506057 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 379/757] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:41 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 26378 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 04:21:42.517868 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-5910e135-488c-4e50-978f-b8be4019db1a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:42.519449 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-5910e135-488c-4e50-978f-b8be4019db1a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:42.527148 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5910e135-488c-4e50-978f-b8be4019db1a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:42.527592 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5910e135-488c-4e50-978f-b8be4019db1a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:42.528477 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5910e135-488c-4e50-978f-b8be4019db1a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:42.528862 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5910e135-488c-4e50-978f-b8be4019db1a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:42.613443 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-5910e135-488c-4e50-978f-b8be4019db1a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 27389 microversion: 2.1 time: 0.098864 Oct 12 04:21:42.614823 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 379/758] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:42 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 27389 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 04:21:43.626170 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-a0b8ba60-920c-44ca-bde7-7054600221fa tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:43.627198 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-a0b8ba60-920c-44ca-bde7-7054600221fa tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:43.633755 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a0b8ba60-920c-44ca-bde7-7054600221fa tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:43.634206 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a0b8ba60-920c-44ca-bde7-7054600221fa tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:43.635000 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a0b8ba60-920c-44ca-bde7-7054600221fa tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:43.635438 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a0b8ba60-920c-44ca-bde7-7054600221fa tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:43.724586 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-a0b8ba60-920c-44ca-bde7-7054600221fa tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 27869 microversion: 2.1 time: 0.102265 Oct 12 04:21:43.725433 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 380/759] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:43 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 27869 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:21:43.763213 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-bd865447-22e9-46dd-b998-837443301cf5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:43.763822 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-bd865447-22e9-46dd-b998-837443301cf5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:43.770839 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-bd865447-22e9-46dd-b998-837443301cf5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:43.771284 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-bd865447-22e9-46dd-b998-837443301cf5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:43.772029 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-bd865447-22e9-46dd-b998-837443301cf5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:43.772447 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-bd865447-22e9-46dd-b998-837443301cf5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:43.795406 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.objects.instance [None req-bd865447-22e9-46dd-b998-837443301cf5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lazy-loading 'flavor' on Instance uuid 12862c4a-cd3e-4b8e-91b3-9dbe108af390 {{(pid=108898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:21:44.263077 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-bd865447-22e9-46dd-b998-837443301cf5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 202 len: 0 microversion: 2.20 time: 0.503867 Oct 12 04:21:44.264010 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 380/760] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:21:43 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 12 04:21:44.272408 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-19dfd551-2ba3-4d52-9a0c-c06786a6f6ae tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:44.273126 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-19dfd551-2ba3-4d52-9a0c-c06786a6f6ae tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:44.279559 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-19dfd551-2ba3-4d52-9a0c-c06786a6f6ae tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:44.279998 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-19dfd551-2ba3-4d52-9a0c-c06786a6f6ae tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:44.280780 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-19dfd551-2ba3-4d52-9a0c-c06786a6f6ae tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:44.281210 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-19dfd551-2ba3-4d52-9a0c-c06786a6f6ae tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:44.407902 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-19dfd551-2ba3-4d52-9a0c-c06786a6f6ae tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:44.416004 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-19dfd551-2ba3-4d52-9a0c-c06786a6f6ae tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:44.417518 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-19dfd551-2ba3-4d52-9a0c-c06786a6f6ae tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:44.418687 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-19dfd551-2ba3-4d52-9a0c-c06786a6f6ae tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1722 microversion: 2.20 time: 0.150293 Oct 12 04:21:44.419239 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 381/761] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:21:44 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:21:44.737138 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-9350ce3e-f3e4-45f4-9a8a-bfd34c25db78 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:44.738816 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-9350ce3e-f3e4-45f4-9a8a-bfd34c25db78 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:44.744878 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9350ce3e-f3e4-45f4-9a8a-bfd34c25db78 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:44.745321 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9350ce3e-f3e4-45f4-9a8a-bfd34c25db78 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:44.746075 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9350ce3e-f3e4-45f4-9a8a-bfd34c25db78 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:44.746505 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9350ce3e-f3e4-45f4-9a8a-bfd34c25db78 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:44.823208 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-9350ce3e-f3e4-45f4-9a8a-bfd34c25db78 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 28182 microversion: 2.1 time: 0.089896 Oct 12 04:21:44.823858 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 381/762] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:44 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 28182 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 04:21:45.441447 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-57f36920-9d5e-4aa5-b69e-cfa23a09fac0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:45.442052 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-57f36920-9d5e-4aa5-b69e-cfa23a09fac0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:45.448270 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-57f36920-9d5e-4aa5-b69e-cfa23a09fac0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:45.448722 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-57f36920-9d5e-4aa5-b69e-cfa23a09fac0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:45.449477 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-57f36920-9d5e-4aa5-b69e-cfa23a09fac0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:45.449902 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-57f36920-9d5e-4aa5-b69e-cfa23a09fac0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:45.570023 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-57f36920-9d5e-4aa5-b69e-cfa23a09fac0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:45.577571 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-57f36920-9d5e-4aa5-b69e-cfa23a09fac0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:45.579083 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-57f36920-9d5e-4aa5-b69e-cfa23a09fac0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:45.580214 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-57f36920-9d5e-4aa5-b69e-cfa23a09fac0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1722 microversion: 2.20 time: 0.142957 Oct 12 04:21:45.580755 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 382/763] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:21:45 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1722 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:21:45.836998 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-7a027b30-87d9-46fd-9179-8e7fd394df26 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:45.837986 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-7a027b30-87d9-46fd-9179-8e7fd394df26 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:45.844618 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7a027b30-87d9-46fd-9179-8e7fd394df26 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:45.845065 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7a027b30-87d9-46fd-9179-8e7fd394df26 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:45.846277 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7a027b30-87d9-46fd-9179-8e7fd394df26 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:45.846872 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7a027b30-87d9-46fd-9179-8e7fd394df26 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:45.913059 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-7a027b30-87d9-46fd-9179-8e7fd394df26 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 28182 microversion: 2.1 time: 0.081926 Oct 12 04:21:45.913701 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 382/764] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:45 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 28182 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 04:21:46.599174 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-4e3c0ac8-b900-458e-b609-1cf15c56b502 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:46.599789 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-4e3c0ac8-b900-458e-b609-1cf15c56b502 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:46.605561 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4e3c0ac8-b900-458e-b609-1cf15c56b502 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:46.606012 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4e3c0ac8-b900-458e-b609-1cf15c56b502 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:46.607043 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4e3c0ac8-b900-458e-b609-1cf15c56b502 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:46.607472 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4e3c0ac8-b900-458e-b609-1cf15c56b502 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:46.728320 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-4e3c0ac8-b900-458e-b609-1cf15c56b502 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:46.737100 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-4e3c0ac8-b900-458e-b609-1cf15c56b502 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:46.739273 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-4e3c0ac8-b900-458e-b609-1cf15c56b502 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:46.740689 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-4e3c0ac8-b900-458e-b609-1cf15c56b502 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1722 microversion: 2.20 time: 0.145340 Oct 12 04:21:46.741313 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 383/765] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:21:46 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:21:46.925410 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d7358e2b-f03b-44bd-b6a6-86ec1394cc44 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:46.926977 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-d7358e2b-f03b-44bd-b6a6-86ec1394cc44 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:46.933653 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d7358e2b-f03b-44bd-b6a6-86ec1394cc44 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:46.934265 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d7358e2b-f03b-44bd-b6a6-86ec1394cc44 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:46.935256 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d7358e2b-f03b-44bd-b6a6-86ec1394cc44 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:46.935629 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d7358e2b-f03b-44bd-b6a6-86ec1394cc44 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:47.004477 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-d7358e2b-f03b-44bd-b6a6-86ec1394cc44 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 28182 microversion: 2.1 time: 0.082999 Oct 12 04:21:47.005119 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 383/766] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:46 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 28182 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:21:47.759271 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-c07531d6-872b-4eb3-bdf3-995216881f95 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:47.759883 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-c07531d6-872b-4eb3-bdf3-995216881f95 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:47.766035 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c07531d6-872b-4eb3-bdf3-995216881f95 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:47.766486 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c07531d6-872b-4eb3-bdf3-995216881f95 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:47.767280 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c07531d6-872b-4eb3-bdf3-995216881f95 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:47.767719 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c07531d6-872b-4eb3-bdf3-995216881f95 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:47.889467 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-c07531d6-872b-4eb3-bdf3-995216881f95 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:47.897007 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-c07531d6-872b-4eb3-bdf3-995216881f95 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:47.898481 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-c07531d6-872b-4eb3-bdf3-995216881f95 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:47.899652 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-c07531d6-872b-4eb3-bdf3-995216881f95 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1722 microversion: 2.20 time: 0.144079 Oct 12 04:21:47.900198 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 384/767] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:21:47 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1722 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:21:48.016650 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-4005e522-728c-4701-a4d1-8fa01df2017e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:48.017585 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-4005e522-728c-4701-a4d1-8fa01df2017e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:48.023960 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4005e522-728c-4701-a4d1-8fa01df2017e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:48.024401 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4005e522-728c-4701-a4d1-8fa01df2017e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:48.025149 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4005e522-728c-4701-a4d1-8fa01df2017e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:48.025572 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4005e522-728c-4701-a4d1-8fa01df2017e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:48.104781 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-4005e522-728c-4701-a4d1-8fa01df2017e tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 28473 microversion: 2.1 time: 0.091996 Oct 12 04:21:48.105424 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 384/768] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:48 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 28473 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:21:48.919692 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ef679e71-5618-4b6b-9632-3749ba9ef0ef tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:48.920301 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ef679e71-5618-4b6b-9632-3749ba9ef0ef tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:48.926102 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ef679e71-5618-4b6b-9632-3749ba9ef0ef tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:48.926551 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ef679e71-5618-4b6b-9632-3749ba9ef0ef tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:48.927463 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ef679e71-5618-4b6b-9632-3749ba9ef0ef tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:48.927899 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ef679e71-5618-4b6b-9632-3749ba9ef0ef tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:49.117024 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-0416bfe5-f0c6-4206-9ed0-06ed0cce4557 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:49.118049 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-0416bfe5-f0c6-4206-9ed0-06ed0cce4557 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:49.124553 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0416bfe5-f0c6-4206-9ed0-06ed0cce4557 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:49.125007 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0416bfe5-f0c6-4206-9ed0-06ed0cce4557 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:49.125786 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0416bfe5-f0c6-4206-9ed0-06ed0cce4557 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:49.126479 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0416bfe5-f0c6-4206-9ed0-06ed0cce4557 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:49.150961 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-ef679e71-5618-4b6b-9632-3749ba9ef0ef tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:49.158833 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-ef679e71-5618-4b6b-9632-3749ba9ef0ef tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:49.160314 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-ef679e71-5618-4b6b-9632-3749ba9ef0ef tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:49.161476 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ef679e71-5618-4b6b-9632-3749ba9ef0ef tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1722 microversion: 2.20 time: 0.245572 Oct 12 04:21:49.162022 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 385/769] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:21:48 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:21:49.203197 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-0416bfe5-f0c6-4206-9ed0-06ed0cce4557 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 28640 microversion: 2.1 time: 0.089922 Oct 12 04:21:49.203770 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 385/770] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:49 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 28640 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 04:21:50.179554 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-7cfc27b9-bc72-44fe-b539-bcf74c6a47db tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:50.180137 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-7cfc27b9-bc72-44fe-b539-bcf74c6a47db tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:50.186333 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7cfc27b9-bc72-44fe-b539-bcf74c6a47db tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:50.186871 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7cfc27b9-bc72-44fe-b539-bcf74c6a47db tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:50.187654 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7cfc27b9-bc72-44fe-b539-bcf74c6a47db tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:50.188087 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7cfc27b9-bc72-44fe-b539-bcf74c6a47db tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:50.216443 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-f6c606ca-a7f0-4f0f-a035-831b25fbe3a5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:50.217475 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-f6c606ca-a7f0-4f0f-a035-831b25fbe3a5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:50.223939 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f6c606ca-a7f0-4f0f-a035-831b25fbe3a5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:50.224447 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f6c606ca-a7f0-4f0f-a035-831b25fbe3a5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:50.225809 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f6c606ca-a7f0-4f0f-a035-831b25fbe3a5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:50.226239 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f6c606ca-a7f0-4f0f-a035-831b25fbe3a5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:50.288323 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-f6c606ca-a7f0-4f0f-a035-831b25fbe3a5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 28640 microversion: 2.1 time: 0.075036 Oct 12 04:21:50.292270 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 386/771] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:50 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 28640 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 04:21:50.309401 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-7cfc27b9-bc72-44fe-b539-bcf74c6a47db tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:50.317090 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-7cfc27b9-bc72-44fe-b539-bcf74c6a47db tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:50.327603 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-7cfc27b9-bc72-44fe-b539-bcf74c6a47db tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:50.327603 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-7cfc27b9-bc72-44fe-b539-bcf74c6a47db tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1722 microversion: 2.20 time: 0.143901 Oct 12 04:21:50.327603 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 386/772] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:21:50 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1722 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:21:51.300641 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-c3f9dfa7-55de-42a6-b31a-32fa2eff295a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:51.301780 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-c3f9dfa7-55de-42a6-b31a-32fa2eff295a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:51.309010 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c3f9dfa7-55de-42a6-b31a-32fa2eff295a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:51.309463 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c3f9dfa7-55de-42a6-b31a-32fa2eff295a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:51.310225 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c3f9dfa7-55de-42a6-b31a-32fa2eff295a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:51.310676 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c3f9dfa7-55de-42a6-b31a-32fa2eff295a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:51.338179 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-d9a40f96-268f-4485-b0ef-11d1b1486372 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:51.338808 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-d9a40f96-268f-4485-b0ef-11d1b1486372 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:51.344513 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d9a40f96-268f-4485-b0ef-11d1b1486372 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:51.344956 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d9a40f96-268f-4485-b0ef-11d1b1486372 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:51.345723 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d9a40f96-268f-4485-b0ef-11d1b1486372 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:51.346151 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d9a40f96-268f-4485-b0ef-11d1b1486372 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:51.379936 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-c3f9dfa7-55de-42a6-b31a-32fa2eff295a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 28640 microversion: 2.1 time: 0.083120 Oct 12 04:21:51.380762 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 387/773] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:51 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 28640 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:21:51.471055 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-d9a40f96-268f-4485-b0ef-11d1b1486372 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:51.479064 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-d9a40f96-268f-4485-b0ef-11d1b1486372 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:51.480543 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-d9a40f96-268f-4485-b0ef-11d1b1486372 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:51.481922 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-d9a40f96-268f-4485-b0ef-11d1b1486372 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1722 microversion: 2.20 time: 0.147190 Oct 12 04:21:51.482467 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 387/774] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:21:51 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:21:52.391816 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-a299e7de-04ed-416a-8e74-6adbdd8c240a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:52.394976 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-a299e7de-04ed-416a-8e74-6adbdd8c240a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:52.399129 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a299e7de-04ed-416a-8e74-6adbdd8c240a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:52.399565 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a299e7de-04ed-416a-8e74-6adbdd8c240a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:52.400318 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a299e7de-04ed-416a-8e74-6adbdd8c240a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:52.400742 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a299e7de-04ed-416a-8e74-6adbdd8c240a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:52.467543 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-a299e7de-04ed-416a-8e74-6adbdd8c240a tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 28640 microversion: 2.1 time: 0.079415 Oct 12 04:21:52.468430 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 388/775] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:52 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 28640 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:21:52.500457 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-58c8b762-5834-4404-be7b-10c925e52d76 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:52.501059 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-58c8b762-5834-4404-be7b-10c925e52d76 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:52.507902 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-58c8b762-5834-4404-be7b-10c925e52d76 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:52.508343 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-58c8b762-5834-4404-be7b-10c925e52d76 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:52.509102 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-58c8b762-5834-4404-be7b-10c925e52d76 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:52.509532 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-58c8b762-5834-4404-be7b-10c925e52d76 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:52.628201 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-58c8b762-5834-4404-be7b-10c925e52d76 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:52.636688 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-58c8b762-5834-4404-be7b-10c925e52d76 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:52.638112 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-58c8b762-5834-4404-be7b-10c925e52d76 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:52.639275 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-58c8b762-5834-4404-be7b-10c925e52d76 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1722 microversion: 2.20 time: 0.142442 Oct 12 04:21:52.639824 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 388/776] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:21:52 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1722 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:21:53.479923 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-3dbe36f6-16c4-4880-a371-209fc6aeac7b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:53.480980 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-3dbe36f6-16c4-4880-a371-209fc6aeac7b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:53.487501 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3dbe36f6-16c4-4880-a371-209fc6aeac7b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:53.487948 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3dbe36f6-16c4-4880-a371-209fc6aeac7b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:53.488703 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3dbe36f6-16c4-4880-a371-209fc6aeac7b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:53.489135 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3dbe36f6-16c4-4880-a371-209fc6aeac7b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:53.563840 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-3dbe36f6-16c4-4880-a371-209fc6aeac7b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 29330 microversion: 2.1 time: 0.087849 Oct 12 04:21:53.564441 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 389/777] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:53 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 29330 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:21:53.657165 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-95202e2a-99cd-497d-bbd3-f82cb5786b21 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:53.657769 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-95202e2a-99cd-497d-bbd3-f82cb5786b21 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:53.663960 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-95202e2a-99cd-497d-bbd3-f82cb5786b21 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:53.666451 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-95202e2a-99cd-497d-bbd3-f82cb5786b21 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:53.666451 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-95202e2a-99cd-497d-bbd3-f82cb5786b21 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:53.666451 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-95202e2a-99cd-497d-bbd3-f82cb5786b21 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:53.784954 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-95202e2a-99cd-497d-bbd3-f82cb5786b21 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:53.792666 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-95202e2a-99cd-497d-bbd3-f82cb5786b21 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:53.794148 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-95202e2a-99cd-497d-bbd3-f82cb5786b21 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:53.795306 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-95202e2a-99cd-497d-bbd3-f82cb5786b21 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1722 microversion: 2.20 time: 0.141941 Oct 12 04:21:53.795850 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 389/778] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:21:53 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1722 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:21:54.576188 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-3b35d7f2-737f-45f9-90d8-834ebe15f521 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:54.577193 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-3b35d7f2-737f-45f9-90d8-834ebe15f521 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:54.583569 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3b35d7f2-737f-45f9-90d8-834ebe15f521 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:54.584020 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3b35d7f2-737f-45f9-90d8-834ebe15f521 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:54.584782 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3b35d7f2-737f-45f9-90d8-834ebe15f521 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:54.585215 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3b35d7f2-737f-45f9-90d8-834ebe15f521 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:54.672839 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-3b35d7f2-737f-45f9-90d8-834ebe15f521 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 30878 microversion: 2.1 time: 0.100616 Oct 12 04:21:54.673702 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 390/779] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:54 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 30878 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:21:54.813224 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-6d07a350-ffb8-4ed9-8456-c12d3a84ce51 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:54.813819 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-6d07a350-ffb8-4ed9-8456-c12d3a84ce51 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:54.820197 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6d07a350-ffb8-4ed9-8456-c12d3a84ce51 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:54.825600 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6d07a350-ffb8-4ed9-8456-c12d3a84ce51 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:54.825600 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6d07a350-ffb8-4ed9-8456-c12d3a84ce51 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:54.825600 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6d07a350-ffb8-4ed9-8456-c12d3a84ce51 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:54.941609 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-6d07a350-ffb8-4ed9-8456-c12d3a84ce51 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:54.949432 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-6d07a350-ffb8-4ed9-8456-c12d3a84ce51 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:54.950944 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-6d07a350-ffb8-4ed9-8456-c12d3a84ce51 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:54.952084 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-6d07a350-ffb8-4ed9-8456-c12d3a84ce51 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1722 microversion: 2.20 time: 0.142588 Oct 12 04:21:54.952626 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 390/780] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:21:54 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1722 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:21:55.684967 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-1fde25ba-3e49-4592-ac6c-3e01761dc7e0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:55.685974 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-1fde25ba-3e49-4592-ac6c-3e01761dc7e0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:55.692461 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1fde25ba-3e49-4592-ac6c-3e01761dc7e0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:55.692902 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1fde25ba-3e49-4592-ac6c-3e01761dc7e0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:55.694150 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1fde25ba-3e49-4592-ac6c-3e01761dc7e0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:55.694576 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1fde25ba-3e49-4592-ac6c-3e01761dc7e0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:55.784375 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-1fde25ba-3e49-4592-ac6c-3e01761dc7e0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 32333 microversion: 2.1 time: 0.102816 Oct 12 04:21:55.785241 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 391/781] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:55 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 32333 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:21:55.974361 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-8c668599-80b8-4e0a-9d87-24a39e5d065f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:55.974989 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-8c668599-80b8-4e0a-9d87-24a39e5d065f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:55.980662 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8c668599-80b8-4e0a-9d87-24a39e5d065f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:55.981110 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8c668599-80b8-4e0a-9d87-24a39e5d065f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:55.982121 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8c668599-80b8-4e0a-9d87-24a39e5d065f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:55.982562 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8c668599-80b8-4e0a-9d87-24a39e5d065f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:56.108817 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-8c668599-80b8-4e0a-9d87-24a39e5d065f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:56.120916 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-8c668599-80b8-4e0a-9d87-24a39e5d065f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:56.123368 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-8c668599-80b8-4e0a-9d87-24a39e5d065f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:56.125130 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-8c668599-80b8-4e0a-9d87-24a39e5d065f tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1743 microversion: 2.20 time: 0.154263 Oct 12 04:21:56.125966 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 391/782] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:21:55 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:21:56.796592 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-8e718b7e-6a30-408a-82f9-15bcc65e1b6d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:56.797606 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-8e718b7e-6a30-408a-82f9-15bcc65e1b6d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:56.804918 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8e718b7e-6a30-408a-82f9-15bcc65e1b6d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:56.805361 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8e718b7e-6a30-408a-82f9-15bcc65e1b6d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:56.806113 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8e718b7e-6a30-408a-82f9-15bcc65e1b6d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:56.806539 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8e718b7e-6a30-408a-82f9-15bcc65e1b6d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:56.889957 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-8e718b7e-6a30-408a-82f9-15bcc65e1b6d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 33626 microversion: 2.1 time: 0.097098 Oct 12 04:21:56.890482 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 392/783] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:56 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 33626 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:21:57.144480 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-19f67f06-e0da-4832-99d6-e6086088054c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:57.145010 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-19f67f06-e0da-4832-99d6-e6086088054c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:57.150828 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-19f67f06-e0da-4832-99d6-e6086088054c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:57.151284 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-19f67f06-e0da-4832-99d6-e6086088054c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:57.152031 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-19f67f06-e0da-4832-99d6-e6086088054c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:57.152460 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-19f67f06-e0da-4832-99d6-e6086088054c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:57.270416 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-19f67f06-e0da-4832-99d6-e6086088054c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:57.278187 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-19f67f06-e0da-4832-99d6-e6086088054c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:57.279702 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-19f67f06-e0da-4832-99d6-e6086088054c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:57.280827 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-19f67f06-e0da-4832-99d6-e6086088054c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1743 microversion: 2.20 time: 0.140149 Oct 12 04:21:57.281376 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 392/784] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:21:57 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1743 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:21:57.660177 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-80820d18-5655-4674-8593-6bdee22a42a4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1567606081", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1444809609", "security_groups": [{"name": "tempest-secgroup-smoke-677187580"}], "networks": [{"uuid": "ff0b57d6-156b-4ab0-b3fb-88070e9c6a54"}], "block_device_mapping_v2": [{"uuid": "374a4d74-044a-470f-9aab-45328e14ef02", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:57.850769 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.network.neutron [None req-80820d18-5655-4674-8593-6bdee22a42a4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] validate_networks() for [('ff0b57d6-156b-4ab0-b3fb-88070e9c6a54', None, None, None, None, None)] {{(pid=108898) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 04:21:57.902024 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-4d27dede-f30b-4709-9142-8b9afc9671ce tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:57.902853 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-4d27dede-f30b-4709-9142-8b9afc9671ce tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:57.908577 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4d27dede-f30b-4709-9142-8b9afc9671ce tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:57.909021 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4d27dede-f30b-4709-9142-8b9afc9671ce tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:57.909770 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4d27dede-f30b-4709-9142-8b9afc9671ce tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:57.910225 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4d27dede-f30b-4709-9142-8b9afc9671ce tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:57.997253 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-4d27dede-f30b-4709-9142-8b9afc9671ce tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 34849 microversion: 2.1 time: 0.098745 Oct 12 04:21:58.001730 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 393/785] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:57 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 34849 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 04:21:58.245333 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-80820d18-5655-4674-8593-6bdee22a42a4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Flavor limits 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 04:21:58.245753 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-80820d18-5655-4674-8593-6bdee22a42a4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Image limits 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 04:21:58.246219 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-80820d18-5655-4674-8593-6bdee22a42a4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Flavor pref 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 04:21:58.246619 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-80820d18-5655-4674-8593-6bdee22a42a4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Image pref 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 04:21:58.247085 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-80820d18-5655-4674-8593-6bdee22a42a4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 04:21:58.255762 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-80820d18-5655-4674-8593-6bdee22a42a4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:58.256751 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-80820d18-5655-4674-8593-6bdee22a42a4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:58.257555 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-80820d18-5655-4674-8593-6bdee22a42a4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:58.257986 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-80820d18-5655-4674-8593-6bdee22a42a4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:58.274145 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-80820d18-5655-4674-8593-6bdee22a42a4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Getting quotas for project 06a5619d6cc54f8cb1261bb15c0fa58a. Resources: {'cores', 'instances', 'ram'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:21:58.278009 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-80820d18-5655-4674-8593-6bdee22a42a4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Getting quotas for user 69fefb7c10a94985a659a180ca85d560 and project 06a5619d6cc54f8cb1261bb15c0fa58a. Resources: {'cores', 'instances', 'ram'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:21:58.299716 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-aaf304b4-fbf3-4225-99d3-44a9941fbaba tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:58.300411 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-aaf304b4-fbf3-4225-99d3-44a9941fbaba tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:58.307333 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-aaf304b4-fbf3-4225-99d3-44a9941fbaba tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:58.307780 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-aaf304b4-fbf3-4225-99d3-44a9941fbaba tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:58.308547 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-aaf304b4-fbf3-4225-99d3-44a9941fbaba tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:58.308979 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-aaf304b4-fbf3-4225-99d3-44a9941fbaba tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:58.332671 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-80820d18-5655-4674-8593-6bdee22a42a4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Going to run 1 instances... {{(pid=108898) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 04:21:58.335172 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-80820d18-5655-4674-8593-6bdee22a42a4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='374a4d74-044a-470f-9aab-45328e14ef02',volume_size=None,volume_type=None)] {{(pid=108898) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 04:21:58.448260 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-aaf304b4-fbf3-4225-99d3-44a9941fbaba tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:58.460930 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-aaf304b4-fbf3-4225-99d3-44a9941fbaba tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:58.463050 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-aaf304b4-fbf3-4225-99d3-44a9941fbaba tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:58.464314 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-aaf304b4-fbf3-4225-99d3-44a9941fbaba tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1743 microversion: 2.20 time: 0.168514 Oct 12 04:21:58.464868 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 394/786] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:21:58 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:21:58.874773 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-80820d18-5655-4674-8593-6bdee22a42a4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.218553 Oct 12 04:21:58.875714 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 393/787] 10.222.0.21 () {60 vars in 1146 bytes} [Tue Oct 12 04:21:57 2021] POST /compute/v2.1/servers => generated 405 bytes in 1220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 04:21:58.885863 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-23ea8d9e-abc3-4ddd-91f6-5d9d1bf9f99d tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:58.886830 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-23ea8d9e-abc3-4ddd-91f6-5d9d1bf9f99d tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:58.968838 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-23ea8d9e-abc3-4ddd-91f6-5d9d1bf9f99d tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:58.976786 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-23ea8d9e-abc3-4ddd-91f6-5d9d1bf9f99d tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1089 microversion: 2.1 time: 0.094984 Oct 12 04:21:58.978580 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 395/788] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:21:58 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1089 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:21:59.009827 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-738d8ae8-6547-4ee2-a0ec-73d662ef480f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:21:59.010308 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-738d8ae8-6547-4ee2-a0ec-73d662ef480f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:59.017261 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-738d8ae8-6547-4ee2-a0ec-73d662ef480f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:59.017706 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-738d8ae8-6547-4ee2-a0ec-73d662ef480f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:59.018465 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-738d8ae8-6547-4ee2-a0ec-73d662ef480f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:59.018921 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-738d8ae8-6547-4ee2-a0ec-73d662ef480f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:59.093815 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-738d8ae8-6547-4ee2-a0ec-73d662ef480f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 35875 microversion: 2.1 time: 0.088014 Oct 12 04:21:59.094489 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 394/789] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:21:59 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 35875 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:21:59.483786 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-61707a37-5965-42a3-aa1e-3f3a47b640c1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:59.484325 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-61707a37-5965-42a3-aa1e-3f3a47b640c1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:21:59.490332 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-61707a37-5965-42a3-aa1e-3f3a47b640c1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:59.490848 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-61707a37-5965-42a3-aa1e-3f3a47b640c1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:59.491618 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-61707a37-5965-42a3-aa1e-3f3a47b640c1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:21:59.492054 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-61707a37-5965-42a3-aa1e-3f3a47b640c1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:21:59.646251 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-61707a37-5965-42a3-aa1e-3f3a47b640c1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:59.656478 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-61707a37-5965-42a3-aa1e-3f3a47b640c1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:59.658369 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-61707a37-5965-42a3-aa1e-3f3a47b640c1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:21:59.659736 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-61707a37-5965-42a3-aa1e-3f3a47b640c1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1738 microversion: 2.20 time: 0.180046 Oct 12 04:21:59.660693 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 396/790] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:21:59 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:21:59.995297 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-b6b847fb-64da-47cb-8653-f53fc08b47ae tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:21:59.996687 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-b6b847fb-64da-47cb-8653-f53fc08b47ae tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:00.059208 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-b6b847fb-64da-47cb-8653-f53fc08b47ae tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:00.066371 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-b6b847fb-64da-47cb-8653-f53fc08b47ae tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1089 microversion: 2.1 time: 0.075210 Oct 12 04:22:00.074825 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 395/791] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:21:59 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1089 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:22:00.227938 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-7701853d-fea9-4312-976a-98feafd7ce32 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:22:00.228961 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-7701853d-fea9-4312-976a-98feafd7ce32 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:00.235795 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7701853d-fea9-4312-976a-98feafd7ce32 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:00.236588 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7701853d-fea9-4312-976a-98feafd7ce32 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:00.237628 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7701853d-fea9-4312-976a-98feafd7ce32 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:00.238315 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7701853d-fea9-4312-976a-98feafd7ce32 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:00.331390 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-7701853d-fea9-4312-976a-98feafd7ce32 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 37133 microversion: 2.1 time: 0.226413 Oct 12 04:22:00.335653 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 397/792] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:22:00 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 37133 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:22:00.683383 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-34a31a2e-364c-4307-83ef-27346daf7511 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:00.684759 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-34a31a2e-364c-4307-83ef-27346daf7511 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:00.692134 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-34a31a2e-364c-4307-83ef-27346daf7511 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:00.692680 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-34a31a2e-364c-4307-83ef-27346daf7511 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:00.693883 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-34a31a2e-364c-4307-83ef-27346daf7511 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:00.694379 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-34a31a2e-364c-4307-83ef-27346daf7511 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:00.775964 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-3f1be7be-9575-4704-a6bc-24ba7e319bba req-762baeae-eecf-4a0d-a584-96fdbab34dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12862c4a-cd3e-4b8e-91b3-9dbe108af390", "name": "network-vif-plugged", "status": "completed", "tag": "5617efe3-71de-4588-bef7-3cd445452960"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:22:00.778751 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:22:00.778751 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:22:00.795859 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-3f1be7be-9575-4704-a6bc-24ba7e319bba req-762baeae-eecf-4a0d-a584-96fdbab34dc9 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:00.796303 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-3f1be7be-9575-4704-a6bc-24ba7e319bba req-762baeae-eecf-4a0d-a584-96fdbab34dc9 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:00.810144 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-3f1be7be-9575-4704-a6bc-24ba7e319bba req-762baeae-eecf-4a0d-a584-96fdbab34dc9 service nova] Creating event network-vif-plugged:5617efe3-71de-4588-bef7-3cd445452960 for instance 12862c4a-cd3e-4b8e-91b3-9dbe108af390 on hv-cinder-81306 Oct 12 04:22:00.815890 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-3f1be7be-9575-4704-a6bc-24ba7e319bba req-762baeae-eecf-4a0d-a584-96fdbab34dc9 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048602 Oct 12 04:22:00.817187 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 398/793] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:22:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:22:00.876715 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-34a31a2e-364c-4307-83ef-27346daf7511 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:00.890537 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-34a31a2e-364c-4307-83ef-27346daf7511 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:00.892384 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-34a31a2e-364c-4307-83ef-27346daf7511 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:00.893880 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-34a31a2e-364c-4307-83ef-27346daf7511 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1738 microversion: 2.20 time: 0.214721 Oct 12 04:22:00.894495 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 396/794] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:00 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:22:01.085731 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-19441586-2f48-4c23-9b03-9a050ffc206d tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:01.086800 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-19441586-2f48-4c23-9b03-9a050ffc206d tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:01.093253 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-19441586-2f48-4c23-9b03-9a050ffc206d tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:01.093772 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-19441586-2f48-4c23-9b03-9a050ffc206d tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:01.094614 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-19441586-2f48-4c23-9b03-9a050ffc206d tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:01.095140 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-19441586-2f48-4c23-9b03-9a050ffc206d tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:01.158709 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-19441586-2f48-4c23-9b03-9a050ffc206d tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:01.166715 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-19441586-2f48-4c23-9b03-9a050ffc206d tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1187 microversion: 2.1 time: 0.084902 Oct 12 04:22:01.168382 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 399/795] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:22:01 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:22:01.343275 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d8bb47a0-cbaa-43e8-9598-8396b1ef0570 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:22:01.344301 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-d8bb47a0-cbaa-43e8-9598-8396b1ef0570 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:01.353385 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d8bb47a0-cbaa-43e8-9598-8396b1ef0570 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:01.353834 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d8bb47a0-cbaa-43e8-9598-8396b1ef0570 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:01.354614 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d8bb47a0-cbaa-43e8-9598-8396b1ef0570 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:01.359377 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d8bb47a0-cbaa-43e8-9598-8396b1ef0570 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:01.441679 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-d8bb47a0-cbaa-43e8-9598-8396b1ef0570 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 38094 microversion: 2.1 time: 0.101275 Oct 12 04:22:01.443301 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 397/796] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:22:01 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 38094 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:22:01.914031 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-20fc3d93-578e-41d5-87ba-f2e4abf2c1d9 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:01.914736 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-20fc3d93-578e-41d5-87ba-f2e4abf2c1d9 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:01.921548 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-20fc3d93-578e-41d5-87ba-f2e4abf2c1d9 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:01.922245 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-20fc3d93-578e-41d5-87ba-f2e4abf2c1d9 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:01.923342 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-20fc3d93-578e-41d5-87ba-f2e4abf2c1d9 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:01.923873 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-20fc3d93-578e-41d5-87ba-f2e4abf2c1d9 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:02.069802 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-20fc3d93-578e-41d5-87ba-f2e4abf2c1d9 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:02.078121 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-20fc3d93-578e-41d5-87ba-f2e4abf2c1d9 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:02.079672 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-20fc3d93-578e-41d5-87ba-f2e4abf2c1d9 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:02.080899 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-20fc3d93-578e-41d5-87ba-f2e4abf2c1d9 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1738 microversion: 2.20 time: 0.172153 Oct 12 04:22:02.081547 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 400/797] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:01 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:22:02.185417 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d22acc6a-6ea3-4580-a257-96e62ee65384 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:02.186182 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-d22acc6a-6ea3-4580-a257-96e62ee65384 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:02.194206 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d22acc6a-6ea3-4580-a257-96e62ee65384 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:02.194913 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d22acc6a-6ea3-4580-a257-96e62ee65384 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:02.195809 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d22acc6a-6ea3-4580-a257-96e62ee65384 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:02.196284 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d22acc6a-6ea3-4580-a257-96e62ee65384 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:02.259359 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-d22acc6a-6ea3-4580-a257-96e62ee65384 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:02.266594 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-d22acc6a-6ea3-4580-a257-96e62ee65384 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1205 microversion: 2.1 time: 0.085616 Oct 12 04:22:02.267186 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 398/798] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:22:02 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1205 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:22:02.455173 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-44c20bcb-dc8f-4522-83ce-b4cf1b286a46 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:22:02.456270 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-44c20bcb-dc8f-4522-83ce-b4cf1b286a46 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:02.462185 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-44c20bcb-dc8f-4522-83ce-b4cf1b286a46 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:02.462631 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-44c20bcb-dc8f-4522-83ce-b4cf1b286a46 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:02.463420 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-44c20bcb-dc8f-4522-83ce-b4cf1b286a46 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:02.463851 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-44c20bcb-dc8f-4522-83ce-b4cf1b286a46 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:02.546237 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-44c20bcb-dc8f-4522-83ce-b4cf1b286a46 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 38166 microversion: 2.1 time: 0.094380 Oct 12 04:22:02.552512 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 401/799] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:22:02 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 38166 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:22:03.102495 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-85680c40-a1f0-4e00-8c44-d1bba302ddca tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:03.103312 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-85680c40-a1f0-4e00-8c44-d1bba302ddca tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:03.117131 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-85680c40-a1f0-4e00-8c44-d1bba302ddca tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:03.117581 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-85680c40-a1f0-4e00-8c44-d1bba302ddca tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:03.118750 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-85680c40-a1f0-4e00-8c44-d1bba302ddca tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:03.119414 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-85680c40-a1f0-4e00-8c44-d1bba302ddca tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:03.292878 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-85680c40-a1f0-4e00-8c44-d1bba302ddca tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:03.293423 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-900e96c5-6a72-4a82-ba01-7b6d0a2a4dd1 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:03.296678 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-900e96c5-6a72-4a82-ba01-7b6d0a2a4dd1 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:03.305799 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-85680c40-a1f0-4e00-8c44-d1bba302ddca tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:03.307391 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-85680c40-a1f0-4e00-8c44-d1bba302ddca tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:03.308570 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-85680c40-a1f0-4e00-8c44-d1bba302ddca tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1738 microversion: 2.20 time: 0.210124 Oct 12 04:22:03.310605 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-900e96c5-6a72-4a82-ba01-7b6d0a2a4dd1 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:03.315230 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 399/800] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:03 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:22:03.315870 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-900e96c5-6a72-4a82-ba01-7b6d0a2a4dd1 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:03.316679 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-900e96c5-6a72-4a82-ba01-7b6d0a2a4dd1 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:03.317319 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-900e96c5-6a72-4a82-ba01-7b6d0a2a4dd1 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:03.483110 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-900e96c5-6a72-4a82-ba01-7b6d0a2a4dd1 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:03.492606 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-900e96c5-6a72-4a82-ba01-7b6d0a2a4dd1 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1260 microversion: 2.1 time: 0.206517 Oct 12 04:22:03.494295 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 402/801] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:22:03 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:22:03.561084 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-061695a5-5c7a-4adc-9cb1-83a398c415a3 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:22:03.562371 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-061695a5-5c7a-4adc-9cb1-83a398c415a3 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:03.573344 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-061695a5-5c7a-4adc-9cb1-83a398c415a3 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:03.574141 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-061695a5-5c7a-4adc-9cb1-83a398c415a3 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:03.575338 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-061695a5-5c7a-4adc-9cb1-83a398c415a3 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:03.576034 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-061695a5-5c7a-4adc-9cb1-83a398c415a3 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:03.654701 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-061695a5-5c7a-4adc-9cb1-83a398c415a3 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 38166 microversion: 2.1 time: 0.097318 Oct 12 04:22:03.656254 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 400/802] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:22:03 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 38166 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:22:03.784971 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-15838387-fe43-42de-8a05-bf40a9ca5462 req-7dfaad85-c1a9-4a8b-b688-e389a497e406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e51919f-b58c-4be5-8869-721e03482c90", "tag": "6126ee1a-6898-4a1c-af64-989fc7fae65a"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:22:03.784971 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:22:03.784971 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:22:03.790976 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-15838387-fe43-42de-8a05-bf40a9ca5462 req-7dfaad85-c1a9-4a8b-b688-e389a497e406 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:03.791411 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-15838387-fe43-42de-8a05-bf40a9ca5462 req-7dfaad85-c1a9-4a8b-b688-e389a497e406 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:03.806302 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-15838387-fe43-42de-8a05-bf40a9ca5462 req-7dfaad85-c1a9-4a8b-b688-e389a497e406 service nova] Creating event network-changed:6126ee1a-6898-4a1c-af64-989fc7fae65a for instance 2e51919f-b58c-4be5-8869-721e03482c90 on hv-cinder-81306 Oct 12 04:22:03.812610 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-15838387-fe43-42de-8a05-bf40a9ca5462 req-7dfaad85-c1a9-4a8b-b688-e389a497e406 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036163 Oct 12 04:22:03.815099 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 403/803] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:22:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:22:04.328085 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-90027d1c-17fb-4386-a534-a8a612706b25 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:04.329450 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-90027d1c-17fb-4386-a534-a8a612706b25 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:04.339994 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-90027d1c-17fb-4386-a534-a8a612706b25 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:04.339994 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-90027d1c-17fb-4386-a534-a8a612706b25 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:04.339994 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-90027d1c-17fb-4386-a534-a8a612706b25 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:04.339994 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-90027d1c-17fb-4386-a534-a8a612706b25 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:04.492456 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-90027d1c-17fb-4386-a534-a8a612706b25 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:04.506918 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-90027d1c-17fb-4386-a534-a8a612706b25 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:04.506918 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-90027d1c-17fb-4386-a534-a8a612706b25 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:04.507402 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-90027d1c-17fb-4386-a534-a8a612706b25 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1738 microversion: 2.20 time: 0.182972 Oct 12 04:22:04.519246 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 401/804] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:04 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:22:04.523109 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-c7d539ad-6574-4b13-bead-26e463436a0e tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:04.523877 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-c7d539ad-6574-4b13-bead-26e463436a0e tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:04.530806 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c7d539ad-6574-4b13-bead-26e463436a0e tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:04.531263 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c7d539ad-6574-4b13-bead-26e463436a0e tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:04.532040 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c7d539ad-6574-4b13-bead-26e463436a0e tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:04.532474 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c7d539ad-6574-4b13-bead-26e463436a0e tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:04.667734 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-44987891-16db-4b7c-9e90-2384205e6574 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:22:04.669092 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-44987891-16db-4b7c-9e90-2384205e6574 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:04.671054 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-c7d539ad-6574-4b13-bead-26e463436a0e tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:04.676448 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-44987891-16db-4b7c-9e90-2384205e6574 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:04.677130 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-44987891-16db-4b7c-9e90-2384205e6574 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:04.678106 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-44987891-16db-4b7c-9e90-2384205e6574 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:04.678791 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-44987891-16db-4b7c-9e90-2384205e6574 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:04.681075 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-c7d539ad-6574-4b13-bead-26e463436a0e tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1260 microversion: 2.1 time: 0.172634 Oct 12 04:22:04.683109 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 404/805] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:22:04 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:22:04.744486 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-44987891-16db-4b7c-9e90-2384205e6574 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 38166 microversion: 2.1 time: 0.080442 Oct 12 04:22:04.749557 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 402/806] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:22:04 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 38166 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 04:22:05.526101 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-43d95c25-ec4a-40b6-9da0-16f4ef4dee6a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:05.526737 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-43d95c25-ec4a-40b6-9da0-16f4ef4dee6a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:05.533081 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-43d95c25-ec4a-40b6-9da0-16f4ef4dee6a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:05.533513 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-43d95c25-ec4a-40b6-9da0-16f4ef4dee6a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:05.534302 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-43d95c25-ec4a-40b6-9da0-16f4ef4dee6a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:05.534767 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-43d95c25-ec4a-40b6-9da0-16f4ef4dee6a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:05.657589 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-43d95c25-ec4a-40b6-9da0-16f4ef4dee6a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:05.665454 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-43d95c25-ec4a-40b6-9da0-16f4ef4dee6a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:05.666960 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-43d95c25-ec4a-40b6-9da0-16f4ef4dee6a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:05.668105 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-43d95c25-ec4a-40b6-9da0-16f4ef4dee6a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1738 microversion: 2.20 time: 0.146538 Oct 12 04:22:05.668655 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 405/807] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:05 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:22:05.698548 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-f211851b-810f-41aa-b6a6-70833ae9ca9d tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:05.699295 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-f211851b-810f-41aa-b6a6-70833ae9ca9d tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:05.705649 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f211851b-810f-41aa-b6a6-70833ae9ca9d tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:05.706098 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f211851b-810f-41aa-b6a6-70833ae9ca9d tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:05.706895 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f211851b-810f-41aa-b6a6-70833ae9ca9d tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:05.707326 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f211851b-810f-41aa-b6a6-70833ae9ca9d tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:05.758349 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-41df1d26-2b7e-40f6-a411-70689bb3a100 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:22:05.759595 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-41df1d26-2b7e-40f6-a411-70689bb3a100 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:05.765820 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-41df1d26-2b7e-40f6-a411-70689bb3a100 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:05.766260 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-41df1d26-2b7e-40f6-a411-70689bb3a100 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:05.767056 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-41df1d26-2b7e-40f6-a411-70689bb3a100 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:05.767485 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-41df1d26-2b7e-40f6-a411-70689bb3a100 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:05.830189 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-41df1d26-2b7e-40f6-a411-70689bb3a100 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 38166 microversion: 2.1 time: 0.076814 Oct 12 04:22:05.834452 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 406/808] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:22:05 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 38166 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:22:05.839369 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-f211851b-810f-41aa-b6a6-70833ae9ca9d tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:05.848558 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-f211851b-810f-41aa-b6a6-70833ae9ca9d tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1260 microversion: 2.1 time: 0.154428 Oct 12 04:22:05.849245 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 403/809] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:22:05 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:22:06.686771 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-c68682dc-eacb-4874-9df1-f1070e932f51 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:06.688087 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-c68682dc-eacb-4874-9df1-f1070e932f51 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:06.697133 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c68682dc-eacb-4874-9df1-f1070e932f51 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:06.697585 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c68682dc-eacb-4874-9df1-f1070e932f51 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:06.698743 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c68682dc-eacb-4874-9df1-f1070e932f51 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:06.699195 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c68682dc-eacb-4874-9df1-f1070e932f51 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:06.834452 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-c68682dc-eacb-4874-9df1-f1070e932f51 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:06.842013 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d3e78933-62f9-45b1-9e69-0bc2c56f9385 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:22:06.842941 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-d3e78933-62f9-45b1-9e69-0bc2c56f9385 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:06.843830 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-c68682dc-eacb-4874-9df1-f1070e932f51 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:06.845315 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-c68682dc-eacb-4874-9df1-f1070e932f51 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:06.851490 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-c68682dc-eacb-4874-9df1-f1070e932f51 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1738 microversion: 2.20 time: 0.168625 Oct 12 04:22:06.852620 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 407/810] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:06 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:22:06.853783 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d3e78933-62f9-45b1-9e69-0bc2c56f9385 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:06.854236 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d3e78933-62f9-45b1-9e69-0bc2c56f9385 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:06.855055 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d3e78933-62f9-45b1-9e69-0bc2c56f9385 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:06.855644 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d3e78933-62f9-45b1-9e69-0bc2c56f9385 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:06.873062 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-4571dd49-9a7b-4da3-85d5-9c1f83c6bd16 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:06.873682 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-4571dd49-9a7b-4da3-85d5-9c1f83c6bd16 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:06.887622 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4571dd49-9a7b-4da3-85d5-9c1f83c6bd16 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:06.888062 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4571dd49-9a7b-4da3-85d5-9c1f83c6bd16 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:06.888829 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4571dd49-9a7b-4da3-85d5-9c1f83c6bd16 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:06.889255 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4571dd49-9a7b-4da3-85d5-9c1f83c6bd16 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:06.941524 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-d3e78933-62f9-45b1-9e69-0bc2c56f9385 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 38232 microversion: 2.1 time: 0.103443 Oct 12 04:22:06.947169 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 404/811] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:22:06 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 38232 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:22:07.030633 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-4571dd49-9a7b-4da3-85d5-9c1f83c6bd16 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:07.039142 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-4571dd49-9a7b-4da3-85d5-9c1f83c6bd16 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1260 microversion: 2.1 time: 0.175358 Oct 12 04:22:07.049090 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 408/812] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:22:06 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:22:07.871634 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-82172540-44c8-4114-b70a-39c6eed84644 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:07.872931 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-82172540-44c8-4114-b70a-39c6eed84644 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:07.879898 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-82172540-44c8-4114-b70a-39c6eed84644 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:07.880520 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-82172540-44c8-4114-b70a-39c6eed84644 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:07.881487 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-82172540-44c8-4114-b70a-39c6eed84644 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:07.882191 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-82172540-44c8-4114-b70a-39c6eed84644 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:07.955195 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-fa69129c-c7fe-4379-bd9b-3ac7c21e9947 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:22:07.956720 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-fa69129c-c7fe-4379-bd9b-3ac7c21e9947 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:07.964187 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fa69129c-c7fe-4379-bd9b-3ac7c21e9947 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:07.964904 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fa69129c-c7fe-4379-bd9b-3ac7c21e9947 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:07.965878 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fa69129c-c7fe-4379-bd9b-3ac7c21e9947 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:07.966503 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fa69129c-c7fe-4379-bd9b-3ac7c21e9947 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:08.026303 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-82172540-44c8-4114-b70a-39c6eed84644 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:08.034526 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-82172540-44c8-4114-b70a-39c6eed84644 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:08.036373 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-82172540-44c8-4114-b70a-39c6eed84644 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:08.039112 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-82172540-44c8-4114-b70a-39c6eed84644 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1738 microversion: 2.20 time: 0.173407 Oct 12 04:22:08.042215 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-fa69129c-c7fe-4379-bd9b-3ac7c21e9947 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action" status: 200 len: 38295 microversion: 2.1 time: 0.090445 Oct 12 04:22:08.043821 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 409/813] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:22:07 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/action => generated 38295 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 04:22:08.050206 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 405/814] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:07 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:22:08.053061 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-74c2e121-2c3b-4ac3-ae24-90d05ad4ce6d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:08.053670 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-74c2e121-2c3b-4ac3-ae24-90d05ad4ce6d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:08.056173 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-9003d8f6-f472-4296-bf13-82a3fc8fde1d tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:08.056780 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-9003d8f6-f472-4296-bf13-82a3fc8fde1d tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:08.064338 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9003d8f6-f472-4296-bf13-82a3fc8fde1d tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:08.065116 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9003d8f6-f472-4296-bf13-82a3fc8fde1d tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:08.066104 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9003d8f6-f472-4296-bf13-82a3fc8fde1d tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:08.066764 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9003d8f6-f472-4296-bf13-82a3fc8fde1d tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:08.067546 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-74c2e121-2c3b-4ac3-ae24-90d05ad4ce6d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:08.068195 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-74c2e121-2c3b-4ac3-ae24-90d05ad4ce6d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:08.068967 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-74c2e121-2c3b-4ac3-ae24-90d05ad4ce6d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:08.069725 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-74c2e121-2c3b-4ac3-ae24-90d05ad4ce6d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:08.099903 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-74c2e121-2c3b-4ac3-ae24-90d05ad4ce6d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/ips" status: 200 len: 145 microversion: 2.1 time: 0.050598 Oct 12 04:22:08.101622 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 410/815] 10.222.0.21 () {58 vars in 1247 bytes} [Tue Oct 12 04:22:08 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/ips => generated 145 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:22:08.220158 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-9003d8f6-f472-4296-bf13-82a3fc8fde1d tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:08.231959 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-9003d8f6-f472-4296-bf13-82a3fc8fde1d tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1260 microversion: 2.1 time: 0.178967 Oct 12 04:22:08.236524 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 406/816] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:22:08 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:22:09.057672 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-601971e5-416d-44bb-b9b7-8470268e2969 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:09.058266 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-601971e5-416d-44bb-b9b7-8470268e2969 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:09.065215 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-601971e5-416d-44bb-b9b7-8470268e2969 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:09.065663 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-601971e5-416d-44bb-b9b7-8470268e2969 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:09.066418 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-601971e5-416d-44bb-b9b7-8470268e2969 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:09.066876 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-601971e5-416d-44bb-b9b7-8470268e2969 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:09.190258 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-601971e5-416d-44bb-b9b7-8470268e2969 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:09.197860 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-601971e5-416d-44bb-b9b7-8470268e2969 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:09.199458 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-601971e5-416d-44bb-b9b7-8470268e2969 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:09.200604 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-601971e5-416d-44bb-b9b7-8470268e2969 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1738 microversion: 2.20 time: 0.147161 Oct 12 04:22:09.201203 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 411/817] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:09 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:22:09.248995 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-c33b5103-dd77-425d-83bc-75ca14592ec0 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:09.249616 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-c33b5103-dd77-425d-83bc-75ca14592ec0 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:09.255792 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c33b5103-dd77-425d-83bc-75ca14592ec0 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:09.256243 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c33b5103-dd77-425d-83bc-75ca14592ec0 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:09.257009 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c33b5103-dd77-425d-83bc-75ca14592ec0 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:09.257442 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c33b5103-dd77-425d-83bc-75ca14592ec0 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:09.378169 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c33b5103-dd77-425d-83bc-75ca14592ec0 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:09.386133 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-c33b5103-dd77-425d-83bc-75ca14592ec0 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1260 microversion: 2.1 time: 0.140852 Oct 12 04:22:09.386728 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 407/818] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:22:09 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1260 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:22:09.754188 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-2ffc6674-70c5-4b0e-b6a6-d54ff8e86dd4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81e869bb-cbf7-4770-87f5-9f22b30adb50"}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:22:09.755297 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-2ffc6674-70c5-4b0e-b6a6-d54ff8e86dd4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:09.761808 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2ffc6674-70c5-4b0e-b6a6-d54ff8e86dd4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:09.762456 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2ffc6674-70c5-4b0e-b6a6-d54ff8e86dd4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:09.763428 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2ffc6674-70c5-4b0e-b6a6-d54ff8e86dd4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:09.764016 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2ffc6674-70c5-4b0e-b6a6-d54ff8e86dd4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:10.217957 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-a0f6f568-5c13-452b-806a-47cd5775b8f3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:10.218437 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-a0f6f568-5c13-452b-806a-47cd5775b8f3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:10.224269 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a0f6f568-5c13-452b-806a-47cd5775b8f3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:10.224715 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a0f6f568-5c13-452b-806a-47cd5775b8f3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:10.225479 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a0f6f568-5c13-452b-806a-47cd5775b8f3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:10.225912 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a0f6f568-5c13-452b-806a-47cd5775b8f3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:10.354646 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-a0f6f568-5c13-452b-806a-47cd5775b8f3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:10.362516 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-a0f6f568-5c13-452b-806a-47cd5775b8f3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:10.364030 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-a0f6f568-5c13-452b-806a-47cd5775b8f3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:10.365805 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-a0f6f568-5c13-452b-806a-47cd5775b8f3 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1738 microversion: 2.20 time: 0.151426 Oct 12 04:22:10.367231 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 408/819] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:10 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:22:10.402266 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-15b30cce-9897-4a59-8235-973690bc9137 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:10.407222 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-15b30cce-9897-4a59-8235-973690bc9137 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:10.408684 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-15b30cce-9897-4a59-8235-973690bc9137 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:10.409127 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-15b30cce-9897-4a59-8235-973690bc9137 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:10.409893 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-15b30cce-9897-4a59-8235-973690bc9137 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:10.410329 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-15b30cce-9897-4a59-8235-973690bc9137 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:10.461469 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-2ffc6674-70c5-4b0e-b6a6-d54ff8e86dd4 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.710320 Oct 12 04:22:10.462153 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 412/820] 10.222.0.21 () {60 vars in 1322 bytes} [Tue Oct 12 04:22:09 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/os-volume_attachments => generated 194 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:22:10.538105 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-15b30cce-9897-4a59-8235-973690bc9137 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:10.546378 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-15b30cce-9897-4a59-8235-973690bc9137 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1260 microversion: 2.1 time: 0.148124 Oct 12 04:22:10.552668 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 409/821] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:22:10 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:22:11.387038 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-9b6d2b44-25e0-4c00-a29e-5089ffb5ec89 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:11.387729 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-9b6d2b44-25e0-4c00-a29e-5089ffb5ec89 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:11.394161 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9b6d2b44-25e0-4c00-a29e-5089ffb5ec89 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:11.394604 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9b6d2b44-25e0-4c00-a29e-5089ffb5ec89 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:11.395395 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9b6d2b44-25e0-4c00-a29e-5089ffb5ec89 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:11.395860 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9b6d2b44-25e0-4c00-a29e-5089ffb5ec89 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:11.533310 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-9b6d2b44-25e0-4c00-a29e-5089ffb5ec89 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:11.541257 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-9b6d2b44-25e0-4c00-a29e-5089ffb5ec89 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:11.542840 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-9b6d2b44-25e0-4c00-a29e-5089ffb5ec89 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:11.544004 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-9b6d2b44-25e0-4c00-a29e-5089ffb5ec89 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1720 microversion: 2.20 time: 0.161044 Oct 12 04:22:11.544548 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 413/822] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:11 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:22:11.563029 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d823df6c-c133-4fdf-ad4d-ed288b562d48 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:11.564067 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-d823df6c-c133-4fdf-ad4d-ed288b562d48 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:11.579034 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d823df6c-c133-4fdf-ad4d-ed288b562d48 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:11.579488 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d823df6c-c133-4fdf-ad4d-ed288b562d48 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:11.580265 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d823df6c-c133-4fdf-ad4d-ed288b562d48 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:11.580698 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d823df6c-c133-4fdf-ad4d-ed288b562d48 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:11.702575 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-d823df6c-c133-4fdf-ad4d-ed288b562d48 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:11.710264 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-d823df6c-c133-4fdf-ad4d-ed288b562d48 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1260 microversion: 2.1 time: 0.150639 Oct 12 04:22:11.710856 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 410/823] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:22:11 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:22:12.657711 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-a6f8154d-3bc9-458c-bdf2-c4d98a392f11 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:12.658330 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-a6f8154d-3bc9-458c-bdf2-c4d98a392f11 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:12.664474 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a6f8154d-3bc9-458c-bdf2-c4d98a392f11 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:12.664913 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a6f8154d-3bc9-458c-bdf2-c4d98a392f11 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:12.665660 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a6f8154d-3bc9-458c-bdf2-c4d98a392f11 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:12.666080 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a6f8154d-3bc9-458c-bdf2-c4d98a392f11 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:12.726563 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-9baf93eb-95f0-4d3b-8899-864b78ecdbdd tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:12.727742 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-9baf93eb-95f0-4d3b-8899-864b78ecdbdd tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:12.734132 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9baf93eb-95f0-4d3b-8899-864b78ecdbdd tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:12.734579 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9baf93eb-95f0-4d3b-8899-864b78ecdbdd tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:12.735373 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9baf93eb-95f0-4d3b-8899-864b78ecdbdd tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:12.735799 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9baf93eb-95f0-4d3b-8899-864b78ecdbdd tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:12.827124 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-a6f8154d-3bc9-458c-bdf2-c4d98a392f11 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:12.835413 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-a6f8154d-3bc9-458c-bdf2-c4d98a392f11 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:12.836964 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-a6f8154d-3bc9-458c-bdf2-c4d98a392f11 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:12.838108 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-a6f8154d-3bc9-458c-bdf2-c4d98a392f11 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1720 microversion: 2.20 time: 0.279487 Oct 12 04:22:12.838656 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 414/824] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:12 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1720 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:22:12.884326 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-9baf93eb-95f0-4d3b-8899-864b78ecdbdd tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:12.892815 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-9baf93eb-95f0-4d3b-8899-864b78ecdbdd tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1260 microversion: 2.1 time: 0.170723 Oct 12 04:22:12.893406 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 411/825] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:22:12 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:22:13.856043 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-15c5774a-e6a9-4a91-bdcc-f653c586011b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:13.856897 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-15c5774a-e6a9-4a91-bdcc-f653c586011b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:13.863039 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-15c5774a-e6a9-4a91-bdcc-f653c586011b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:13.863488 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-15c5774a-e6a9-4a91-bdcc-f653c586011b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:13.864252 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-15c5774a-e6a9-4a91-bdcc-f653c586011b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:13.864688 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-15c5774a-e6a9-4a91-bdcc-f653c586011b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:13.909732 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-2a81008c-50e8-46a4-8f53-cff21af1b6e0 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:13.910308 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-2a81008c-50e8-46a4-8f53-cff21af1b6e0 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:13.916488 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2a81008c-50e8-46a4-8f53-cff21af1b6e0 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:13.916938 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2a81008c-50e8-46a4-8f53-cff21af1b6e0 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:13.917700 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2a81008c-50e8-46a4-8f53-cff21af1b6e0 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:13.918132 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2a81008c-50e8-46a4-8f53-cff21af1b6e0 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:14.009107 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-15c5774a-e6a9-4a91-bdcc-f653c586011b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:14.016840 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-15c5774a-e6a9-4a91-bdcc-f653c586011b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:14.018375 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-15c5774a-e6a9-4a91-bdcc-f653c586011b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:14.019505 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-15c5774a-e6a9-4a91-bdcc-f653c586011b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1723 microversion: 2.20 time: 0.167249 Oct 12 04:22:14.020062 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 415/826] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:13 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:22:14.037319 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-c13a68bc-732e-4f34-91e6-8dd5b97acd25 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9868079-15a6-41ba-a700-e8870b8bfe9b"}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:22:14.039128 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-c13a68bc-732e-4f34-91e6-8dd5b97acd25 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:14.044869 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c13a68bc-732e-4f34-91e6-8dd5b97acd25 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:14.045318 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c13a68bc-732e-4f34-91e6-8dd5b97acd25 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:14.046363 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c13a68bc-732e-4f34-91e6-8dd5b97acd25 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:14.046494 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c13a68bc-732e-4f34-91e6-8dd5b97acd25 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:14.061583 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-2a81008c-50e8-46a4-8f53-cff21af1b6e0 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:14.068872 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-2a81008c-50e8-46a4-8f53-cff21af1b6e0 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1260 microversion: 2.1 time: 0.162858 Oct 12 04:22:14.069432 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 412/827] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:22:13 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:22:14.857930 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-72b36e10-fe6c-47a2-bd99-644aaaf74d23 req-a4dbd12a-ac2e-4dc5-baaf-07ea64b1874f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e51919f-b58c-4be5-8869-721e03482c90", "name": "network-vif-plugged", "status": "completed", "tag": "6126ee1a-6898-4a1c-af64-989fc7fae65a"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:22:14.859718 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:22:14.859718 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:22:14.866930 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-72b36e10-fe6c-47a2-bd99-644aaaf74d23 req-a4dbd12a-ac2e-4dc5-baaf-07ea64b1874f service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:14.867370 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-72b36e10-fe6c-47a2-bd99-644aaaf74d23 req-a4dbd12a-ac2e-4dc5-baaf-07ea64b1874f service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:14.877806 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-72b36e10-fe6c-47a2-bd99-644aaaf74d23 req-a4dbd12a-ac2e-4dc5-baaf-07ea64b1874f service nova] Creating event network-vif-plugged:6126ee1a-6898-4a1c-af64-989fc7fae65a for instance 2e51919f-b58c-4be5-8869-721e03482c90 on hv-cinder-81306 Oct 12 04:22:14.883267 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-72b36e10-fe6c-47a2-bd99-644aaaf74d23 req-a4dbd12a-ac2e-4dc5-baaf-07ea64b1874f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029135 Oct 12 04:22:14.883823 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 413/828] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:22:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:22:14.941827 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-c13a68bc-732e-4f34-91e6-8dd5b97acd25 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.908103 Oct 12 04:22:14.942606 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 416/829] 10.222.0.21 () {62 vars in 1363 bytes} [Tue Oct 12 04:22:14 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/os-volume_attachments => generated 188 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 04:22:15.066369 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-0dfaf7b2-afce-409f-9367-b65f1c8634fc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:15.067613 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-0dfaf7b2-afce-409f-9367-b65f1c8634fc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:15.077006 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0dfaf7b2-afce-409f-9367-b65f1c8634fc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:15.077694 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0dfaf7b2-afce-409f-9367-b65f1c8634fc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:15.079232 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0dfaf7b2-afce-409f-9367-b65f1c8634fc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:15.080279 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0dfaf7b2-afce-409f-9367-b65f1c8634fc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:15.085517 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-7db600d4-3f9b-4e10-b194-cdbf3aa8e9b7 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:15.087540 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-7db600d4-3f9b-4e10-b194-cdbf3aa8e9b7 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:15.092284 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7db600d4-3f9b-4e10-b194-cdbf3aa8e9b7 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:15.092735 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7db600d4-3f9b-4e10-b194-cdbf3aa8e9b7 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:15.093510 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7db600d4-3f9b-4e10-b194-cdbf3aa8e9b7 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:15.094060 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7db600d4-3f9b-4e10-b194-cdbf3aa8e9b7 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:15.230279 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-7db600d4-3f9b-4e10-b194-cdbf3aa8e9b7 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:15.238782 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-7db600d4-3f9b-4e10-b194-cdbf3aa8e9b7 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1260 microversion: 2.1 time: 0.157059 Oct 12 04:22:15.239352 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 417/830] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:22:15 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:22:15.661511 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-0dfaf7b2-afce-409f-9367-b65f1c8634fc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "DELETE /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/os-volume_attachments/f9868079-15a6-41ba-a700-e8870b8bfe9b" status: 202 len: 0 microversion: 2.20 time: 0.599305 Oct 12 04:22:15.662126 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 414/831] 10.222.0.21 () {60 vars in 1456 bytes} [Tue Oct 12 04:22:15 2021] DELETE /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/os-volume_attachments/f9868079-15a6-41ba-a700-e8870b8bfe9b => generated 0 bytes in 601 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 04:22:15.713698 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-92011c39-3683-4bb2-bda8-a3eeddc50b25 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:22:15.714294 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-92011c39-3683-4bb2-bda8-a3eeddc50b25 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:15.720195 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-92011c39-3683-4bb2-bda8-a3eeddc50b25 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:15.720657 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-92011c39-3683-4bb2-bda8-a3eeddc50b25 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:15.721395 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-92011c39-3683-4bb2-bda8-a3eeddc50b25 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:15.721828 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-92011c39-3683-4bb2-bda8-a3eeddc50b25 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:15.931917 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-92011c39-3683-4bb2-bda8-a3eeddc50b25 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action" status: 202 len: 0 microversion: 2.20 time: 0.222324 Oct 12 04:22:15.932561 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 418/832] 10.222.0.21 () {62 vars in 1318 bytes} [Tue Oct 12 04:22:15 2021] POST /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 04:22:15.940494 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-6f53663e-4254-4ced-ae77-d2472e6aeb69 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:15.941702 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-6f53663e-4254-4ced-ae77-d2472e6aeb69 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:15.948188 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6f53663e-4254-4ced-ae77-d2472e6aeb69 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:15.948702 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6f53663e-4254-4ced-ae77-d2472e6aeb69 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:15.949548 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6f53663e-4254-4ced-ae77-d2472e6aeb69 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:15.950045 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6f53663e-4254-4ced-ae77-d2472e6aeb69 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:16.070117 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-6f53663e-4254-4ced-ae77-d2472e6aeb69 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:16.077765 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-6f53663e-4254-4ced-ae77-d2472e6aeb69 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:16.079308 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-6f53663e-4254-4ced-ae77-d2472e6aeb69 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:16.080445 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-6f53663e-4254-4ced-ae77-d2472e6aeb69 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1671 microversion: 2.20 time: 0.143679 Oct 12 04:22:16.081002 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 415/833] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:15 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1671 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:22:16.263064 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-567637f2-b6e1-48ce-8ea8-a40e99612117 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:16.263064 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-567637f2-b6e1-48ce-8ea8-a40e99612117 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:16.263064 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-567637f2-b6e1-48ce-8ea8-a40e99612117 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:16.263750 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-567637f2-b6e1-48ce-8ea8-a40e99612117 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:16.264173 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-567637f2-b6e1-48ce-8ea8-a40e99612117 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:16.264796 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-567637f2-b6e1-48ce-8ea8-a40e99612117 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:16.390934 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-567637f2-b6e1-48ce-8ea8-a40e99612117 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:16.399162 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-567637f2-b6e1-48ce-8ea8-a40e99612117 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1260 microversion: 2.1 time: 0.147043 Oct 12 04:22:16.400956 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 419/834] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:22:16 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:22:16.899072 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-a43aabad-82de-49c9-b1e9-d1c3943161c5 req-6e526f23-0b41-4272-be39-c7f0f9967b36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12862c4a-cd3e-4b8e-91b3-9dbe108af390", "name": "network-vif-unplugged", "status": "completed", "tag": "5617efe3-71de-4588-bef7-3cd445452960"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:22:16.900614 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:22:16.900614 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:22:16.907442 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-a43aabad-82de-49c9-b1e9-d1c3943161c5 req-6e526f23-0b41-4272-be39-c7f0f9967b36 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:16.907884 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-a43aabad-82de-49c9-b1e9-d1c3943161c5 req-6e526f23-0b41-4272-be39-c7f0f9967b36 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:16.918300 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.compute.server_external_events [req-a43aabad-82de-49c9-b1e9-d1c3943161c5 req-6e526f23-0b41-4272-be39-c7f0f9967b36 service nova] Unable to find a host for instance 12862c4a-cd3e-4b8e-91b3-9dbe108af390. Dropping event network-vif-unplugged {{(pid=108898) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Oct 12 04:22:16.921585 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-a43aabad-82de-49c9-b1e9-d1c3943161c5 req-6e526f23-0b41-4272-be39-c7f0f9967b36 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.024509 Oct 12 04:22:16.921585 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 416/835] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:22:16 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 12 04:22:17.099290 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-914b3f3c-3ee1-48cd-b425-c21f37724e65 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:17.100062 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-914b3f3c-3ee1-48cd-b425-c21f37724e65 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:17.105663 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-914b3f3c-3ee1-48cd-b425-c21f37724e65 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:17.106098 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-914b3f3c-3ee1-48cd-b425-c21f37724e65 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:17.107129 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-914b3f3c-3ee1-48cd-b425-c21f37724e65 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:17.107555 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-914b3f3c-3ee1-48cd-b425-c21f37724e65 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:17.230408 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-914b3f3c-3ee1-48cd-b425-c21f37724e65 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:17.238312 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-914b3f3c-3ee1-48cd-b425-c21f37724e65 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:17.239823 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-914b3f3c-3ee1-48cd-b425-c21f37724e65 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:17.242557 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-914b3f3c-3ee1-48cd-b425-c21f37724e65 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1673 microversion: 2.20 time: 0.145454 Oct 12 04:22:17.242557 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 420/836] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:17 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1673 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:22:17.416151 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-62d527fe-ebfc-4dbf-aedb-1843e01adfe4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:17.416663 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-62d527fe-ebfc-4dbf-aedb-1843e01adfe4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:17.423480 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-62d527fe-ebfc-4dbf-aedb-1843e01adfe4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:17.425327 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-62d527fe-ebfc-4dbf-aedb-1843e01adfe4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:17.425327 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-62d527fe-ebfc-4dbf-aedb-1843e01adfe4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:17.425327 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-62d527fe-ebfc-4dbf-aedb-1843e01adfe4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:17.549020 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-62d527fe-ebfc-4dbf-aedb-1843e01adfe4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:17.556728 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-62d527fe-ebfc-4dbf-aedb-1843e01adfe4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1445 microversion: 2.1 time: 0.144773 Oct 12 04:22:17.557279 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 417/837] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:22:17 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1445 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:22:17.572153 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-73777ba7-42ba-4faf-bee7-c6d9f6f9c585 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:17.572757 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-73777ba7-42ba-4faf-bee7-c6d9f6f9c585 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:17.578363 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-73777ba7-42ba-4faf-bee7-c6d9f6f9c585 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:17.578847 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-73777ba7-42ba-4faf-bee7-c6d9f6f9c585 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:17.579596 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-73777ba7-42ba-4faf-bee7-c6d9f6f9c585 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:17.580019 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-73777ba7-42ba-4faf-bee7-c6d9f6f9c585 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:17.701753 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-73777ba7-42ba-4faf-bee7-c6d9f6f9c585 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:17.709231 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-73777ba7-42ba-4faf-bee7-c6d9f6f9c585 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1445 microversion: 2.1 time: 0.140636 Oct 12 04:22:17.713836 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 421/838] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:22:17 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1445 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:22:17.932513 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-0690a678-d119-4ae6-9474-af3a187640c7 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:17.933585 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-0690a678-d119-4ae6-9474-af3a187640c7 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:17.939603 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0690a678-d119-4ae6-9474-af3a187640c7 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:17.940051 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0690a678-d119-4ae6-9474-af3a187640c7 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:17.940811 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0690a678-d119-4ae6-9474-af3a187640c7 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:17.941241 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0690a678-d119-4ae6-9474-af3a187640c7 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:17.971088 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-0690a678-d119-4ae6-9474-af3a187640c7 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042129 Oct 12 04:22:17.971585 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 418/839] 10.222.0.21 () {58 vars in 1301 bytes} [Tue Oct 12 04:22:17 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:22:17.982514 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-1ae0f0db-6394-45d1-b65f-81381bbe92c5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:17.983291 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-1ae0f0db-6394-45d1-b65f-81381bbe92c5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:17.989538 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1ae0f0db-6394-45d1-b65f-81381bbe92c5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:17.990049 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1ae0f0db-6394-45d1-b65f-81381bbe92c5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:17.991069 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1ae0f0db-6394-45d1-b65f-81381bbe92c5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:17.991715 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1ae0f0db-6394-45d1-b65f-81381bbe92c5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:18.023504 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-1ae0f0db-6394-45d1-b65f-81381bbe92c5 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/os-volume_attachments/81e869bb-cbf7-4770-87f5-9f22b30adb50" status: 200 len: 194 microversion: 2.1 time: 0.045348 Oct 12 04:22:18.024095 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 422/840] 10.222.0.21 () {58 vars in 1412 bytes} [Tue Oct 12 04:22:17 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/os-volume_attachments/81e869bb-cbf7-4770-87f5-9f22b30adb50 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:22:18.260435 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-201b114c-10a6-4ca8-a151-64e428178f1e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:18.261067 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-201b114c-10a6-4ca8-a151-64e428178f1e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:18.267383 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-201b114c-10a6-4ca8-a151-64e428178f1e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:18.267859 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-201b114c-10a6-4ca8-a151-64e428178f1e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:18.268626 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-201b114c-10a6-4ca8-a151-64e428178f1e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:18.269055 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-201b114c-10a6-4ca8-a151-64e428178f1e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:18.476952 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-201b114c-10a6-4ca8-a151-64e428178f1e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:18.485285 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-201b114c-10a6-4ca8-a151-64e428178f1e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:18.486850 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-201b114c-10a6-4ca8-a151-64e428178f1e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:18.488028 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-201b114c-10a6-4ca8-a151-64e428178f1e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1729 microversion: 2.20 time: 0.231837 Oct 12 04:22:18.488841 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 419/841] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:18 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1729 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:22:19.507134 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ab06d229-603c-4f5d-98fc-d8de88e18b0d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:19.507737 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ab06d229-603c-4f5d-98fc-d8de88e18b0d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:19.514135 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ab06d229-603c-4f5d-98fc-d8de88e18b0d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:19.514587 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ab06d229-603c-4f5d-98fc-d8de88e18b0d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:19.515393 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ab06d229-603c-4f5d-98fc-d8de88e18b0d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:19.515823 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ab06d229-603c-4f5d-98fc-d8de88e18b0d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:19.656421 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-451db2f1-c9bf-4895-b76a-696eccb1210f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3209b6d-11a1-44aa-8542-ad5f78fa8f39"}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:22:19.657721 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-451db2f1-c9bf-4895-b76a-696eccb1210f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:19.663946 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-451db2f1-c9bf-4895-b76a-696eccb1210f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:19.664512 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-451db2f1-c9bf-4895-b76a-696eccb1210f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:19.665402 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-451db2f1-c9bf-4895-b76a-696eccb1210f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:19.665938 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-451db2f1-c9bf-4895-b76a-696eccb1210f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:19.751072 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-ab06d229-603c-4f5d-98fc-d8de88e18b0d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:19.760404 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-ab06d229-603c-4f5d-98fc-d8de88e18b0d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:19.761891 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-ab06d229-603c-4f5d-98fc-d8de88e18b0d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:19.763091 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ab06d229-603c-4f5d-98fc-d8de88e18b0d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1729 microversion: 2.20 time: 0.259768 Oct 12 04:22:19.763796 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 423/842] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:19 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1729 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:22:20.234754 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-f9aa496f-7445-433f-9e7b-0772ab017810 req-53358ffb-1d5f-47cd-9317-2c982761dec5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e51919f-b58c-4be5-8869-721e03482c90", "tag": "6126ee1a-6898-4a1c-af64-989fc7fae65a"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:22:20.236417 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:22:20.236417 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:22:20.245855 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-f9aa496f-7445-433f-9e7b-0772ab017810 req-53358ffb-1d5f-47cd-9317-2c982761dec5 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:20.245855 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-f9aa496f-7445-433f-9e7b-0772ab017810 req-53358ffb-1d5f-47cd-9317-2c982761dec5 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:20.261932 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-f9aa496f-7445-433f-9e7b-0772ab017810 req-53358ffb-1d5f-47cd-9317-2c982761dec5 service nova] Creating event network-changed:6126ee1a-6898-4a1c-af64-989fc7fae65a for instance 2e51919f-b58c-4be5-8869-721e03482c90 on hv-cinder-81306 Oct 12 04:22:20.268574 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-f9aa496f-7445-433f-9e7b-0772ab017810 req-53358ffb-1d5f-47cd-9317-2c982761dec5 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103388 Oct 12 04:22:20.269484 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 424/843] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:22:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:22:20.781791 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-a7c91e6f-8088-462b-9c16-07efcb76d89a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:20.782479 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-a7c91e6f-8088-462b-9c16-07efcb76d89a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:20.788841 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a7c91e6f-8088-462b-9c16-07efcb76d89a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:20.789438 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a7c91e6f-8088-462b-9c16-07efcb76d89a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:20.790466 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a7c91e6f-8088-462b-9c16-07efcb76d89a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:20.791235 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a7c91e6f-8088-462b-9c16-07efcb76d89a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:20.937054 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-a7c91e6f-8088-462b-9c16-07efcb76d89a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:20.946098 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-a7c91e6f-8088-462b-9c16-07efcb76d89a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:20.949585 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-a7c91e6f-8088-462b-9c16-07efcb76d89a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:20.951497 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-a7c91e6f-8088-462b-9c16-07efcb76d89a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1729 microversion: 2.20 time: 0.173277 Oct 12 04:22:20.951752 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 425/844] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:20 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:22:21.968677 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-81f7fb80-ea7c-44a3-9cfb-708c9a9936c5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:21.969562 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-81f7fb80-ea7c-44a3-9cfb-708c9a9936c5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:21.975406 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-81f7fb80-ea7c-44a3-9cfb-708c9a9936c5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:21.975848 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-81f7fb80-ea7c-44a3-9cfb-708c9a9936c5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:21.976604 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-81f7fb80-ea7c-44a3-9cfb-708c9a9936c5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:21.977027 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-81f7fb80-ea7c-44a3-9cfb-708c9a9936c5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:22.102782 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-81f7fb80-ea7c-44a3-9cfb-708c9a9936c5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:22.111521 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-81f7fb80-ea7c-44a3-9cfb-708c9a9936c5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:22.112996 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-81f7fb80-ea7c-44a3-9cfb-708c9a9936c5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:22.114128 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-81f7fb80-ea7c-44a3-9cfb-708c9a9936c5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1729 microversion: 2.20 time: 0.149129 Oct 12 04:22:22.114727 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 426/845] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:21 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:22:23.132365 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-4789145c-e4d5-4267-b078-dc094d20e7dc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:23.134331 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-4789145c-e4d5-4267-b078-dc094d20e7dc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:23.140676 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4789145c-e4d5-4267-b078-dc094d20e7dc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:23.141125 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4789145c-e4d5-4267-b078-dc094d20e7dc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:23.141902 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4789145c-e4d5-4267-b078-dc094d20e7dc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:23.142339 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4789145c-e4d5-4267-b078-dc094d20e7dc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:23.266356 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-4789145c-e4d5-4267-b078-dc094d20e7dc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:23.274494 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-4789145c-e4d5-4267-b078-dc094d20e7dc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:23.276006 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-4789145c-e4d5-4267-b078-dc094d20e7dc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:23.277141 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-4789145c-e4d5-4267-b078-dc094d20e7dc tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1729 microversion: 2.20 time: 0.148729 Oct 12 04:22:23.277691 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 427/846] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:23 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:22:24.295983 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-0731b396-d1d7-47ed-9d6c-c2d623ea8209 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:24.296624 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-0731b396-d1d7-47ed-9d6c-c2d623ea8209 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:24.302680 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0731b396-d1d7-47ed-9d6c-c2d623ea8209 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:24.303141 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0731b396-d1d7-47ed-9d6c-c2d623ea8209 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:24.303913 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0731b396-d1d7-47ed-9d6c-c2d623ea8209 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:24.304350 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0731b396-d1d7-47ed-9d6c-c2d623ea8209 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:24.428223 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-0731b396-d1d7-47ed-9d6c-c2d623ea8209 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:24.436461 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-0731b396-d1d7-47ed-9d6c-c2d623ea8209 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:24.437971 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-0731b396-d1d7-47ed-9d6c-c2d623ea8209 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:24.439188 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-0731b396-d1d7-47ed-9d6c-c2d623ea8209 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1729 microversion: 2.20 time: 0.147180 Oct 12 04:22:24.440014 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 428/847] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:24 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1729 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:22:25.458923 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-4816b2d0-2e9c-491f-9e28-f8ff124247d5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:25.459627 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-4816b2d0-2e9c-491f-9e28-f8ff124247d5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:25.466240 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4816b2d0-2e9c-491f-9e28-f8ff124247d5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:25.466760 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4816b2d0-2e9c-491f-9e28-f8ff124247d5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:25.467692 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4816b2d0-2e9c-491f-9e28-f8ff124247d5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:25.468012 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4816b2d0-2e9c-491f-9e28-f8ff124247d5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:25.594375 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-4816b2d0-2e9c-491f-9e28-f8ff124247d5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:25.602897 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-4816b2d0-2e9c-491f-9e28-f8ff124247d5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:25.604368 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-4816b2d0-2e9c-491f-9e28-f8ff124247d5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:25.605494 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-4816b2d0-2e9c-491f-9e28-f8ff124247d5 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1729 microversion: 2.20 time: 0.150276 Oct 12 04:22:25.606038 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 429/848] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:25 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:22:26.623745 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-9dec94f7-25fc-40da-9532-ff9216baace8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:26.624522 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-9dec94f7-25fc-40da-9532-ff9216baace8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:26.631065 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9dec94f7-25fc-40da-9532-ff9216baace8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:26.631546 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9dec94f7-25fc-40da-9532-ff9216baace8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:26.632295 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9dec94f7-25fc-40da-9532-ff9216baace8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:26.632731 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9dec94f7-25fc-40da-9532-ff9216baace8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:26.764311 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-9dec94f7-25fc-40da-9532-ff9216baace8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:26.775354 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-9dec94f7-25fc-40da-9532-ff9216baace8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:26.776952 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-9dec94f7-25fc-40da-9532-ff9216baace8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:26.778297 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-9dec94f7-25fc-40da-9532-ff9216baace8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1729 microversion: 2.20 time: 0.158252 Oct 12 04:22:26.779204 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 430/849] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:26 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:22:27.799552 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-81fd9e3a-3155-4460-8fe9-2e70a3f3465a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:27.800997 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-81fd9e3a-3155-4460-8fe9-2e70a3f3465a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:27.809662 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-81fd9e3a-3155-4460-8fe9-2e70a3f3465a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:27.810114 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-81fd9e3a-3155-4460-8fe9-2e70a3f3465a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:27.811080 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-81fd9e3a-3155-4460-8fe9-2e70a3f3465a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:27.811514 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-81fd9e3a-3155-4460-8fe9-2e70a3f3465a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:27.933374 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-81fd9e3a-3155-4460-8fe9-2e70a3f3465a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:27.941067 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-81fd9e3a-3155-4460-8fe9-2e70a3f3465a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:27.942693 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-81fd9e3a-3155-4460-8fe9-2e70a3f3465a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:27.943831 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-81fd9e3a-3155-4460-8fe9-2e70a3f3465a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1729 microversion: 2.20 time: 0.149229 Oct 12 04:22:27.944956 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 431/850] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:27 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:22:28.963739 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-069910d1-5429-4417-952c-2e5a7d76c7b0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:28.964439 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-069910d1-5429-4417-952c-2e5a7d76c7b0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:28.970294 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-069910d1-5429-4417-952c-2e5a7d76c7b0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:28.970786 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-069910d1-5429-4417-952c-2e5a7d76c7b0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:28.971552 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-069910d1-5429-4417-952c-2e5a7d76c7b0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:28.971985 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-069910d1-5429-4417-952c-2e5a7d76c7b0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:29.100758 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-069910d1-5429-4417-952c-2e5a7d76c7b0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:29.111139 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-069910d1-5429-4417-952c-2e5a7d76c7b0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:29.113942 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-069910d1-5429-4417-952c-2e5a7d76c7b0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:29.115114 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-069910d1-5429-4417-952c-2e5a7d76c7b0 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1729 microversion: 2.20 time: 0.155682 Oct 12 04:22:29.117034 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 432/851] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:28 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:22:30.134979 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-d0d5aab2-e3f4-4878-a99a-c535994dfb3e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:30.135637 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-d0d5aab2-e3f4-4878-a99a-c535994dfb3e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:30.141211 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d0d5aab2-e3f4-4878-a99a-c535994dfb3e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:30.141655 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d0d5aab2-e3f4-4878-a99a-c535994dfb3e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:30.142397 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d0d5aab2-e3f4-4878-a99a-c535994dfb3e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:30.142855 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d0d5aab2-e3f4-4878-a99a-c535994dfb3e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:30.256186 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-451db2f1-c9bf-4895-b76a-696eccb1210f tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.606562 Oct 12 04:22:30.256800 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 420/852] 10.222.0.21 () {60 vars in 1322 bytes} [Tue Oct 12 04:22:19 2021] POST /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/os-volume_attachments => generated 194 bytes in 10608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:22:30.263990 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-d0d5aab2-e3f4-4878-a99a-c535994dfb3e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:30.272460 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-d0d5aab2-e3f4-4878-a99a-c535994dfb3e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:30.274609 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-d0d5aab2-e3f4-4878-a99a-c535994dfb3e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:30.275773 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-d0d5aab2-e3f4-4878-a99a-c535994dfb3e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1729 microversion: 2.20 time: 0.145059 Oct 12 04:22:30.276315 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 433/853] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:30 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1729 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:22:31.294655 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-1daba4d8-2666-4f8c-b480-c1605e8fca2b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:31.295368 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-1daba4d8-2666-4f8c-b480-c1605e8fca2b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:31.302229 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1daba4d8-2666-4f8c-b480-c1605e8fca2b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:31.302688 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1daba4d8-2666-4f8c-b480-c1605e8fca2b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:31.303443 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1daba4d8-2666-4f8c-b480-c1605e8fca2b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:31.303866 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1daba4d8-2666-4f8c-b480-c1605e8fca2b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:31.421823 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-1daba4d8-2666-4f8c-b480-c1605e8fca2b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:31.429338 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-1daba4d8-2666-4f8c-b480-c1605e8fca2b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:31.430848 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-1daba4d8-2666-4f8c-b480-c1605e8fca2b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:31.431981 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-1daba4d8-2666-4f8c-b480-c1605e8fca2b tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1729 microversion: 2.20 time: 0.141793 Oct 12 04:22:31.432535 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 421/854] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:31 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1729 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:22:32.448693 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-74776f21-e5ab-4b53-81d5-626f7a7894b1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:32.449290 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-74776f21-e5ab-4b53-81d5-626f7a7894b1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:32.454947 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-74776f21-e5ab-4b53-81d5-626f7a7894b1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:32.455388 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-74776f21-e5ab-4b53-81d5-626f7a7894b1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:32.456132 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-74776f21-e5ab-4b53-81d5-626f7a7894b1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:32.456561 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-74776f21-e5ab-4b53-81d5-626f7a7894b1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:32.576108 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-74776f21-e5ab-4b53-81d5-626f7a7894b1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:32.583658 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-74776f21-e5ab-4b53-81d5-626f7a7894b1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:32.585143 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-74776f21-e5ab-4b53-81d5-626f7a7894b1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:32.586280 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-74776f21-e5ab-4b53-81d5-626f7a7894b1 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1729 microversion: 2.20 time: 0.141183 Oct 12 04:22:32.586854 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 434/855] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:32 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1729 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:22:33.604249 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-ca6f33d8-88a0-4ee8-acb4-7ca7fc7e50b8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:33.604859 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-ca6f33d8-88a0-4ee8-acb4-7ca7fc7e50b8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:33.611294 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ca6f33d8-88a0-4ee8-acb4-7ca7fc7e50b8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:33.611739 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ca6f33d8-88a0-4ee8-acb4-7ca7fc7e50b8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:33.612507 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ca6f33d8-88a0-4ee8-acb4-7ca7fc7e50b8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:33.612935 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ca6f33d8-88a0-4ee8-acb4-7ca7fc7e50b8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:33.732791 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-ca6f33d8-88a0-4ee8-acb4-7ca7fc7e50b8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:33.740686 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-ca6f33d8-88a0-4ee8-acb4-7ca7fc7e50b8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:33.742750 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-ca6f33d8-88a0-4ee8-acb4-7ca7fc7e50b8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:33.743893 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-ca6f33d8-88a0-4ee8-acb4-7ca7fc7e50b8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1729 microversion: 2.20 time: 0.143308 Oct 12 04:22:33.744436 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 422/856] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:33 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1729 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:22:34.762264 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-8089a3cc-671e-46f5-bc42-ae6c0db62d3e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:34.762896 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-8089a3cc-671e-46f5-bc42-ae6c0db62d3e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:34.768645 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8089a3cc-671e-46f5-bc42-ae6c0db62d3e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:34.769087 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8089a3cc-671e-46f5-bc42-ae6c0db62d3e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:34.769841 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8089a3cc-671e-46f5-bc42-ae6c0db62d3e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:34.770272 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8089a3cc-671e-46f5-bc42-ae6c0db62d3e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:34.910285 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-8089a3cc-671e-46f5-bc42-ae6c0db62d3e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:34.917812 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-8089a3cc-671e-46f5-bc42-ae6c0db62d3e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:34.919319 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-8089a3cc-671e-46f5-bc42-ae6c0db62d3e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:34.920451 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-8089a3cc-671e-46f5-bc42-ae6c0db62d3e tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1729 microversion: 2.20 time: 0.161907 Oct 12 04:22:34.921288 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 435/857] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:34 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:22:35.014224 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-4d5ae556-62ae-41e4-937b-0dbd2a319f14 req-77be0865-74f7-4bed-aafe-ebe0bfbefc57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12862c4a-cd3e-4b8e-91b3-9dbe108af390", "name": "network-vif-plugged", "status": "completed", "tag": "5617efe3-71de-4588-bef7-3cd445452960"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:22:35.016469 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:22:35.016469 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:22:35.023313 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-4d5ae556-62ae-41e4-937b-0dbd2a319f14 req-77be0865-74f7-4bed-aafe-ebe0bfbefc57 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:35.023749 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-4d5ae556-62ae-41e4-937b-0dbd2a319f14 req-77be0865-74f7-4bed-aafe-ebe0bfbefc57 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:35.034437 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-4d5ae556-62ae-41e4-937b-0dbd2a319f14 req-77be0865-74f7-4bed-aafe-ebe0bfbefc57 service nova] Creating event network-vif-plugged:5617efe3-71de-4588-bef7-3cd445452960 for instance 12862c4a-cd3e-4b8e-91b3-9dbe108af390 on hv-cinder-81306 Oct 12 04:22:35.039182 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-4d5ae556-62ae-41e4-937b-0dbd2a319f14 req-77be0865-74f7-4bed-aafe-ebe0bfbefc57 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087472 Oct 12 04:22:35.039814 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 423/858] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:22:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:22:35.938309 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-183e8e28-32b7-4e00-984c-90894ff4db55 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:35.938952 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-183e8e28-32b7-4e00-984c-90894ff4db55 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:35.944754 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-183e8e28-32b7-4e00-984c-90894ff4db55 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:35.945204 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-183e8e28-32b7-4e00-984c-90894ff4db55 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:35.945964 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-183e8e28-32b7-4e00-984c-90894ff4db55 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:35.946402 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-183e8e28-32b7-4e00-984c-90894ff4db55 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:36.067461 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-183e8e28-32b7-4e00-984c-90894ff4db55 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:36.074979 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-183e8e28-32b7-4e00-984c-90894ff4db55 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:36.076451 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-183e8e28-32b7-4e00-984c-90894ff4db55 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:36.077575 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-183e8e28-32b7-4e00-984c-90894ff4db55 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1729 microversion: 2.20 time: 0.142945 Oct 12 04:22:36.078115 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 436/859] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:35 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1729 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:22:37.096856 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-41bcf4a0-b568-4c17-9e06-4d74ba3f167c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:37.097642 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-41bcf4a0-b568-4c17-9e06-4d74ba3f167c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:37.104013 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-41bcf4a0-b568-4c17-9e06-4d74ba3f167c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:37.104460 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-41bcf4a0-b568-4c17-9e06-4d74ba3f167c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:37.105222 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-41bcf4a0-b568-4c17-9e06-4d74ba3f167c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:37.105650 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-41bcf4a0-b568-4c17-9e06-4d74ba3f167c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:37.229189 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-41bcf4a0-b568-4c17-9e06-4d74ba3f167c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:37.237031 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-41bcf4a0-b568-4c17-9e06-4d74ba3f167c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:37.238511 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-41bcf4a0-b568-4c17-9e06-4d74ba3f167c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:37.239675 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-41bcf4a0-b568-4c17-9e06-4d74ba3f167c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1729 microversion: 2.20 time: 0.146992 Oct 12 04:22:37.240223 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 424/860] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:37 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1729 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:22:37.710704 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-01b61fcf-89f2-4684-93ff-2d3245b7e3cf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:37.711666 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-01b61fcf-89f2-4684-93ff-2d3245b7e3cf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:37.717939 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-01b61fcf-89f2-4684-93ff-2d3245b7e3cf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:37.718395 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-01b61fcf-89f2-4684-93ff-2d3245b7e3cf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:37.722116 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-01b61fcf-89f2-4684-93ff-2d3245b7e3cf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:37.722116 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-01b61fcf-89f2-4684-93ff-2d3245b7e3cf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:37.748967 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-01b61fcf-89f2-4684-93ff-2d3245b7e3cf tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041892 Oct 12 04:22:37.749522 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 437/861] 10.222.0.21 () {58 vars in 1301 bytes} [Tue Oct 12 04:22:37 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:22:37.953547 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-a8a5503d-932d-4a11-90ab-5cb96dd1eff6 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:37.953962 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-a8a5503d-932d-4a11-90ab-5cb96dd1eff6 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:37.960147 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a8a5503d-932d-4a11-90ab-5cb96dd1eff6 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:37.961669 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a8a5503d-932d-4a11-90ab-5cb96dd1eff6 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:37.961669 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a8a5503d-932d-4a11-90ab-5cb96dd1eff6 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:37.961866 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a8a5503d-932d-4a11-90ab-5cb96dd1eff6 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:37.989669 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-a8a5503d-932d-4a11-90ab-5cb96dd1eff6 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/os-volume_attachments/81e869bb-cbf7-4770-87f5-9f22b30adb50" status: 200 len: 194 microversion: 2.1 time: 0.039944 Oct 12 04:22:37.990222 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 425/862] 10.222.0.21 () {58 vars in 1412 bytes} [Tue Oct 12 04:22:37 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/os-volume_attachments/81e869bb-cbf7-4770-87f5-9f22b30adb50 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:22:37.999923 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-4089ed40-bef8-405d-8af5-0b23f8d5e553 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:38.000413 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-4089ed40-bef8-405d-8af5-0b23f8d5e553 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:38.006042 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4089ed40-bef8-405d-8af5-0b23f8d5e553 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:38.006488 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4089ed40-bef8-405d-8af5-0b23f8d5e553 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:38.007285 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4089ed40-bef8-405d-8af5-0b23f8d5e553 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:38.007717 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4089ed40-bef8-405d-8af5-0b23f8d5e553 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:38.082466 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.objects.instance [None req-4089ed40-bef8-405d-8af5-0b23f8d5e553 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lazy-loading 'services' on Instance uuid 3f60d1c9-289f-4fa1-a16d-41983b1e56e9 {{(pid=108897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:22:38.258738 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-46ebe13b-9897-4eb3-aa38-da1a2192a457 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:38.259959 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-46ebe13b-9897-4eb3-aa38-da1a2192a457 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:38.265690 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-46ebe13b-9897-4eb3-aa38-da1a2192a457 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:38.266157 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-46ebe13b-9897-4eb3-aa38-da1a2192a457 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:38.266937 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-46ebe13b-9897-4eb3-aa38-da1a2192a457 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:38.267360 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-46ebe13b-9897-4eb3-aa38-da1a2192a457 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:38.314503 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-4089ed40-bef8-405d-8af5-0b23f8d5e553 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "DELETE /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/os-volume_attachments/81e869bb-cbf7-4770-87f5-9f22b30adb50" status: 202 len: 0 microversion: 2.1 time: 0.318035 Oct 12 04:22:38.315271 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 438/863] 10.222.0.21 () {58 vars in 1415 bytes} [Tue Oct 12 04:22:37 2021] DELETE /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/os-volume_attachments/81e869bb-cbf7-4770-87f5-9f22b30adb50 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:22:38.391110 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-46ebe13b-9897-4eb3-aa38-da1a2192a457 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:38.399023 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-46ebe13b-9897-4eb3-aa38-da1a2192a457 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:38.400971 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-46ebe13b-9897-4eb3-aa38-da1a2192a457 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:38.401961 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-46ebe13b-9897-4eb3-aa38-da1a2192a457 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1716 microversion: 2.20 time: 0.147044 Oct 12 04:22:38.402516 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 426/864] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:22:38 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1716 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:22:40.475313 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-c69a81c8-4dd7-4354-bf9f-fb401695b6f8 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:40.475884 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-c69a81c8-4dd7-4354-bf9f-fb401695b6f8 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:40.482693 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c69a81c8-4dd7-4354-bf9f-fb401695b6f8 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:40.483136 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c69a81c8-4dd7-4354-bf9f-fb401695b6f8 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:40.483891 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c69a81c8-4dd7-4354-bf9f-fb401695b6f8 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:40.484329 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c69a81c8-4dd7-4354-bf9f-fb401695b6f8 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:40.511153 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-c69a81c8-4dd7-4354-bf9f-fb401695b6f8 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/os-volume_attachments/e3209b6d-11a1-44aa-8542-ad5f78fa8f39" status: 200 len: 194 microversion: 2.1 time: 0.039861 Oct 12 04:22:40.511701 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 439/865] 10.222.0.21 () {58 vars in 1412 bytes} [Tue Oct 12 04:22:40 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/os-volume_attachments/e3209b6d-11a1-44aa-8542-ad5f78fa8f39 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:22:40.520936 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-ce131385-1d0a-451c-b407-e4892ad5929d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:40.521421 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-ce131385-1d0a-451c-b407-e4892ad5929d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:40.527573 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ce131385-1d0a-451c-b407-e4892ad5929d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:40.528012 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ce131385-1d0a-451c-b407-e4892ad5929d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:40.528754 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ce131385-1d0a-451c-b407-e4892ad5929d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:40.529204 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ce131385-1d0a-451c-b407-e4892ad5929d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:40.604500 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.objects.instance [None req-ce131385-1d0a-451c-b407-e4892ad5929d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lazy-loading 'services' on Instance uuid 3f60d1c9-289f-4fa1-a16d-41983b1e56e9 {{(pid=108898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:22:40.822579 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-ce131385-1d0a-451c-b407-e4892ad5929d tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "DELETE /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/os-volume_attachments/e3209b6d-11a1-44aa-8542-ad5f78fa8f39" status: 202 len: 0 microversion: 2.1 time: 0.305074 Oct 12 04:22:40.823194 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 427/866] 10.222.0.21 () {58 vars in 1415 bytes} [Tue Oct 12 04:22:40 2021] DELETE /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/os-volume_attachments/e3209b6d-11a1-44aa-8542-ad5f78fa8f39 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:22:41.967903 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-066d6ab7-7b19-44c5-a4b1-eb379f62f7bd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:41.968812 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-066d6ab7-7b19-44c5-a4b1-eb379f62f7bd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:41.974463 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-066d6ab7-7b19-44c5-a4b1-eb379f62f7bd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:41.974958 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-066d6ab7-7b19-44c5-a4b1-eb379f62f7bd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:41.975728 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-066d6ab7-7b19-44c5-a4b1-eb379f62f7bd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:41.976160 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-066d6ab7-7b19-44c5-a4b1-eb379f62f7bd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:42.003958 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-066d6ab7-7b19-44c5-a4b1-eb379f62f7bd tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039737 Oct 12 04:22:42.004485 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 440/867] 10.222.0.21 () {58 vars in 1301 bytes} [Tue Oct 12 04:22:41 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 04:22:42.112726 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-85672b18-8fd9-4c93-9446-92054bbfb809 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:42.113744 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-85672b18-8fd9-4c93-9446-92054bbfb809 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:42.119751 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-85672b18-8fd9-4c93-9446-92054bbfb809 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:42.120186 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-85672b18-8fd9-4c93-9446-92054bbfb809 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:42.120931 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-85672b18-8fd9-4c93-9446-92054bbfb809 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:42.121354 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-85672b18-8fd9-4c93-9446-92054bbfb809 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:42.148619 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-85672b18-8fd9-4c93-9446-92054bbfb809 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039908 Oct 12 04:22:42.149145 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 428/868] 10.222.0.21 () {58 vars in 1301 bytes} [Tue Oct 12 04:22:42 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 04:22:42.201838 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-b5005e95-6af8-449f-a4a4-e8eb47881df8 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:42.202330 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-b5005e95-6af8-449f-a4a4-e8eb47881df8 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:42.207888 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b5005e95-6af8-449f-a4a4-e8eb47881df8 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:42.208332 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b5005e95-6af8-449f-a4a4-e8eb47881df8 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:42.209093 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b5005e95-6af8-449f-a4a4-e8eb47881df8 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:42.209532 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b5005e95-6af8-449f-a4a4-e8eb47881df8 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:42.235238 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-b5005e95-6af8-449f-a4a4-e8eb47881df8 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Going to try to terminate instance {{(pid=108897) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 04:22:42.520731 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-b5005e95-6af8-449f-a4a4-e8eb47881df8 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "DELETE /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9" status: 204 len: 0 microversion: 2.1 time: 0.322227 Oct 12 04:22:42.521321 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 441/869] 10.222.0.21 () {58 vars in 1238 bytes} [Tue Oct 12 04:22:42 2021] DELETE /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 04:22:42.532375 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-57a60541-74f0-41e7-bef8-4143715d79d2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:42.533033 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-57a60541-74f0-41e7-bef8-4143715d79d2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:42.538907 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-57a60541-74f0-41e7-bef8-4143715d79d2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:42.539331 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-57a60541-74f0-41e7-bef8-4143715d79d2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:42.540130 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-57a60541-74f0-41e7-bef8-4143715d79d2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:42.540556 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-57a60541-74f0-41e7-bef8-4143715d79d2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:42.662997 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-57a60541-74f0-41e7-bef8-4143715d79d2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:42.669985 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-57a60541-74f0-41e7-bef8-4143715d79d2 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9" status: 200 len: 1673 microversion: 2.1 time: 0.141287 Oct 12 04:22:42.670539 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 429/870] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:22:42 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9 => generated 1673 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:22:43.687495 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-4bebf21f-ed7d-470e-b9fd-e5eb63bbc12b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:43.688177 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-4bebf21f-ed7d-470e-b9fd-e5eb63bbc12b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:43.694224 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4bebf21f-ed7d-470e-b9fd-e5eb63bbc12b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:43.694685 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4bebf21f-ed7d-470e-b9fd-e5eb63bbc12b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:43.695435 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4bebf21f-ed7d-470e-b9fd-e5eb63bbc12b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:43.695856 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4bebf21f-ed7d-470e-b9fd-e5eb63bbc12b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:43.814369 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-4bebf21f-ed7d-470e-b9fd-e5eb63bbc12b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:43.821464 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-4bebf21f-ed7d-470e-b9fd-e5eb63bbc12b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9" status: 200 len: 1673 microversion: 2.1 time: 0.137908 Oct 12 04:22:43.822004 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 442/871] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:22:43 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9 => generated 1673 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:22:44.838647 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-fed89254-f084-4ef5-9eca-5c18acdee242 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:44.839259 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-fed89254-f084-4ef5-9eca-5c18acdee242 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:44.845147 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fed89254-f084-4ef5-9eca-5c18acdee242 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:44.845592 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fed89254-f084-4ef5-9eca-5c18acdee242 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:44.846367 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fed89254-f084-4ef5-9eca-5c18acdee242 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:44.846833 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fed89254-f084-4ef5-9eca-5c18acdee242 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:44.967931 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-fed89254-f084-4ef5-9eca-5c18acdee242 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:44.975932 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-fed89254-f084-4ef5-9eca-5c18acdee242 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9" status: 200 len: 1673 microversion: 2.1 time: 0.141050 Oct 12 04:22:44.976494 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 430/872] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:22:44 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9 => generated 1673 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:22:45.594172 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-8ed7a53e-cdfd-475a-9a82-c65c4b6587fd req-5c847779-0daf-42c3-8508-ec4d06509f8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f60d1c9-289f-4fa1-a16d-41983b1e56e9", "name": "network-vif-deleted", "tag": "ad2c8eae-2e0c-4e91-b413-4ab20a5ad7f2"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:22:45.596370 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:22:45.596370 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:22:45.605379 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-8ed7a53e-cdfd-475a-9a82-c65c4b6587fd req-5c847779-0daf-42c3-8508-ec4d06509f8a service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:45.606409 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-8ed7a53e-cdfd-475a-9a82-c65c4b6587fd req-5c847779-0daf-42c3-8508-ec4d06509f8a service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:45.618566 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-8ed7a53e-cdfd-475a-9a82-c65c4b6587fd req-5c847779-0daf-42c3-8508-ec4d06509f8a service nova] Creating event network-vif-deleted:ad2c8eae-2e0c-4e91-b413-4ab20a5ad7f2 for instance 3f60d1c9-289f-4fa1-a16d-41983b1e56e9 on hv-cinder-81306 Oct 12 04:22:45.624607 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-8ed7a53e-cdfd-475a-9a82-c65c4b6587fd req-5c847779-0daf-42c3-8508-ec4d06509f8a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090222 Oct 12 04:22:45.625705 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 443/873] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:22:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:22:45.993429 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-a86b4e4a-e5fd-4726-a66f-cb470d027e0c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:45.994067 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-a86b4e4a-e5fd-4726-a66f-cb470d027e0c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:46.001052 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a86b4e4a-e5fd-4726-a66f-cb470d027e0c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:46.001508 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a86b4e4a-e5fd-4726-a66f-cb470d027e0c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:46.002291 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a86b4e4a-e5fd-4726-a66f-cb470d027e0c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:46.002748 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a86b4e4a-e5fd-4726-a66f-cb470d027e0c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:46.035595 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a86b4e4a-e5fd-4726-a66f-cb470d027e0c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:46.036043 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a86b4e4a-e5fd-4726-a66f-cb470d027e0c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:46.036489 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.objects.instance [None req-a86b4e4a-e5fd-4726-a66f-cb470d027e0c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lazy-loading 'fault' on Instance uuid 3f60d1c9-289f-4fa1-a16d-41983b1e56e9 {{(pid=108898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:22:46.078989 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-a86b4e4a-e5fd-4726-a66f-cb470d027e0c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ef9f68435646318c114003e8680611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e41211e834d8aaf06b40712cb4893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:22:46.087316 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-a86b4e4a-e5fd-4726-a66f-cb470d027e0c tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9" status: 200 len: 1327 microversion: 2.1 time: 0.097315 Oct 12 04:22:46.088287 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 431/874] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:22:45 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9 => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:22:47.105148 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-b0d1d48d-9055-45ba-b684-8ed0a576bb8b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:47.105837 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-b0d1d48d-9055-45ba-b684-8ed0a576bb8b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:47.112034 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b0d1d48d-9055-45ba-b684-8ed0a576bb8b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:47.112479 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b0d1d48d-9055-45ba-b684-8ed0a576bb8b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:47.113227 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b0d1d48d-9055-45ba-b684-8ed0a576bb8b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:47.113652 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b0d1d48d-9055-45ba-b684-8ed0a576bb8b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:47.128175 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.wsgi [None req-b0d1d48d-9055-45ba-b684-8ed0a576bb8b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] HTTP exception thrown: Instance 3f60d1c9-289f-4fa1-a16d-41983b1e56e9 could not be found. Oct 12 04:22:47.128788 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-b0d1d48d-9055-45ba-b684-8ed0a576bb8b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Returning 404 to user: Instance 3f60d1c9-289f-4fa1-a16d-41983b1e56e9 could not be found. {{(pid=108897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:22:47.129613 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-b0d1d48d-9055-45ba-b684-8ed0a576bb8b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9" status: 404 len: 111 microversion: 2.1 time: 0.028450 Oct 12 04:22:47.130140 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 444/875] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:22:47 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:22:47.139656 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-74f01af4-0842-4110-92e7-83f5d1f9fa77 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '.version_select at 0x7f3855613c10>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:47.229707 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-74f01af4-0842-4110-92e7-83f5d1f9fa77 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1011239324" status: 202 len: 0 microversion: 2.1 time: 0.094098 Oct 12 04:22:47.230190 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 432/876] 10.222.0.21 () {58 vars in 1220 bytes} [Tue Oct 12 04:22:47 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1011239324 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:22:50.448719 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-4e85f1a7-4fe5-471e-9046-37a5526f5cac tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:50.449216 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-4e85f1a7-4fe5-471e-9046-37a5526f5cac tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:50.454971 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4e85f1a7-4fe5-471e-9046-37a5526f5cac tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:50.455421 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4e85f1a7-4fe5-471e-9046-37a5526f5cac tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:50.456179 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4e85f1a7-4fe5-471e-9046-37a5526f5cac tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:50.456608 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4e85f1a7-4fe5-471e-9046-37a5526f5cac tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:50.469663 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.wsgi [None req-4e85f1a7-4fe5-471e-9046-37a5526f5cac tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] HTTP exception thrown: Instance 3f60d1c9-289f-4fa1-a16d-41983b1e56e9 could not be found. Oct 12 04:22:50.470236 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-4e85f1a7-4fe5-471e-9046-37a5526f5cac tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Returning 404 to user: Instance 3f60d1c9-289f-4fa1-a16d-41983b1e56e9 could not be found. {{(pid=108897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:22:50.471071 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-4e85f1a7-4fe5-471e-9046-37a5526f5cac tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "DELETE /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9" status: 404 len: 111 microversion: 2.1 time: 0.025903 Oct 12 04:22:50.471557 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 445/877] 10.222.0.21 () {58 vars in 1238 bytes} [Tue Oct 12 04:22:50 2021] DELETE /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:22:50.479268 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-ab9efbea-fd8f-463d-8da8-c70ffaf4a64b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:50.479884 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-ab9efbea-fd8f-463d-8da8-c70ffaf4a64b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: 3f60d1c9-289f-4fa1-a16d-41983b1e56e9] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:50.486535 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ab9efbea-fd8f-463d-8da8-c70ffaf4a64b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:50.487020 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ab9efbea-fd8f-463d-8da8-c70ffaf4a64b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:50.487788 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ab9efbea-fd8f-463d-8da8-c70ffaf4a64b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:50.488224 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ab9efbea-fd8f-463d-8da8-c70ffaf4a64b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:50.500782 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.wsgi [None req-ab9efbea-fd8f-463d-8da8-c70ffaf4a64b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] HTTP exception thrown: Instance 3f60d1c9-289f-4fa1-a16d-41983b1e56e9 could not be found. Oct 12 04:22:50.501362 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-ab9efbea-fd8f-463d-8da8-c70ffaf4a64b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Returning 404 to user: Instance 3f60d1c9-289f-4fa1-a16d-41983b1e56e9 could not be found. {{(pid=108898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:22:50.502163 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-ab9efbea-fd8f-463d-8da8-c70ffaf4a64b tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9" status: 404 len: 111 microversion: 2.1 time: 0.026605 Oct 12 04:22:50.502680 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 433/878] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:22:50 2021] GET /compute/v2.1/servers/3f60d1c9-289f-4fa1-a16d-41983b1e56e9 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:22:51.809417 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-5346a8ac-7a1c-48c7-b460-30cdcf038437 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:51.809940 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-5346a8ac-7a1c-48c7-b460-30cdcf038437 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:51.815833 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5346a8ac-7a1c-48c7-b460-30cdcf038437 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:51.816281 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5346a8ac-7a1c-48c7-b460-30cdcf038437 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:51.817034 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5346a8ac-7a1c-48c7-b460-30cdcf038437 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:51.817462 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5346a8ac-7a1c-48c7-b460-30cdcf038437 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:51.830104 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.wsgi [None req-5346a8ac-7a1c-48c7-b460-30cdcf038437 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] HTTP exception thrown: Instance bbee8a27-52f2-42c0-8cb5-bfade5bfb587 could not be found. Oct 12 04:22:51.830697 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-5346a8ac-7a1c-48c7-b460-30cdcf038437 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Returning 404 to user: Instance bbee8a27-52f2-42c0-8cb5-bfade5bfb587 could not be found. {{(pid=108897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:22:51.831556 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-5346a8ac-7a1c-48c7-b460-30cdcf038437 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "DELETE /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 404 len: 111 microversion: 2.1 time: 0.026442 Oct 12 04:22:51.832055 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 446/879] 10.222.0.21 () {58 vars in 1238 bytes} [Tue Oct 12 04:22:51 2021] DELETE /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:22:51.839594 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-907ed51e-eb26-4616-97f4-03dd1a11bdb0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:22:51.840688 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-907ed51e-eb26-4616-97f4-03dd1a11bdb0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] [instance: bbee8a27-52f2-42c0-8cb5-bfade5bfb587] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:22:51.846352 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-907ed51e-eb26-4616-97f4-03dd1a11bdb0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:51.846828 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-907ed51e-eb26-4616-97f4-03dd1a11bdb0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:51.847573 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-907ed51e-eb26-4616-97f4-03dd1a11bdb0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:22:51.847996 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-907ed51e-eb26-4616-97f4-03dd1a11bdb0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:22:51.861419 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.wsgi [None req-907ed51e-eb26-4616-97f4-03dd1a11bdb0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] HTTP exception thrown: Instance bbee8a27-52f2-42c0-8cb5-bfade5bfb587 could not be found. Oct 12 04:22:51.861988 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-907ed51e-eb26-4616-97f4-03dd1a11bdb0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] Returning 404 to user: Instance bbee8a27-52f2-42c0-8cb5-bfade5bfb587 could not be found. {{(pid=108898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:22:51.862820 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-907ed51e-eb26-4616-97f4-03dd1a11bdb0 tempest-AttachVolumeTestJSON-1378332929 tempest-AttachVolumeTestJSON-1378332929-project] 10.222.0.21 "GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587" status: 404 len: 111 microversion: 2.1 time: 0.026764 Oct 12 04:22:51.863325 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 434/880] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:22:51 2021] GET /compute/v2.1/servers/bbee8a27-52f2-42c0-8cb5-bfade5bfb587 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:23:11.315130 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ebacc5ed-ce55-4239-a426-2fcb2e569b7c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:11.316356 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ebacc5ed-ce55-4239-a426-2fcb2e569b7c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:11.322788 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ebacc5ed-ce55-4239-a426-2fcb2e569b7c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:11.323439 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ebacc5ed-ce55-4239-a426-2fcb2e569b7c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:11.324245 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ebacc5ed-ce55-4239-a426-2fcb2e569b7c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:11.324683 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ebacc5ed-ce55-4239-a426-2fcb2e569b7c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:11.354641 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ebacc5ed-ce55-4239-a426-2fcb2e569b7c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043232 Oct 12 04:23:11.355210 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 447/881] 10.222.0.21 () {60 vars in 1342 bytes} [Tue Oct 12 04:23:11 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:23:11.412436 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-094b256b-f375-4853-b367-9827c9bf53c8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:11.416421 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-094b256b-f375-4853-b367-9827c9bf53c8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:11.419948 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-094b256b-f375-4853-b367-9827c9bf53c8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:11.420569 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-094b256b-f375-4853-b367-9827c9bf53c8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:11.421652 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-094b256b-f375-4853-b367-9827c9bf53c8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:11.422211 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-094b256b-f375-4853-b367-9827c9bf53c8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:11.446560 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-094b256b-f375-4853-b367-9827c9bf53c8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Going to try to terminate instance {{(pid=108898) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 04:23:11.674680 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-094b256b-f375-4853-b367-9827c9bf53c8 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "DELETE /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 204 len: 0 microversion: 2.20 time: 0.265517 Oct 12 04:23:11.675259 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 435/882] 10.222.0.21 () {60 vars in 1279 bytes} [Tue Oct 12 04:23:11 2021] DELETE /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 04:23:11.683155 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-64b5e39f-095c-47b3-ac26-a0cf9d82fb6a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:11.683758 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-64b5e39f-095c-47b3-ac26-a0cf9d82fb6a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:11.689566 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-64b5e39f-095c-47b3-ac26-a0cf9d82fb6a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:11.690010 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-64b5e39f-095c-47b3-ac26-a0cf9d82fb6a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:11.690805 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-64b5e39f-095c-47b3-ac26-a0cf9d82fb6a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:11.691243 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-64b5e39f-095c-47b3-ac26-a0cf9d82fb6a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:11.816704 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-64b5e39f-095c-47b3-ac26-a0cf9d82fb6a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:11.824332 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-64b5e39f-095c-47b3-ac26-a0cf9d82fb6a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:11.832560 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-64b5e39f-095c-47b3-ac26-a0cf9d82fb6a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:11.832560 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-64b5e39f-095c-47b3-ac26-a0cf9d82fb6a tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1722 microversion: 2.20 time: 0.148069 Oct 12 04:23:11.832560 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 448/883] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:23:11 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 04:23:12.846171 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-c02624ae-9d48-4393-a7d9-7bf18624b35c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:12.847357 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-c02624ae-9d48-4393-a7d9-7bf18624b35c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:12.853079 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c02624ae-9d48-4393-a7d9-7bf18624b35c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:12.853528 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c02624ae-9d48-4393-a7d9-7bf18624b35c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:12.854293 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c02624ae-9d48-4393-a7d9-7bf18624b35c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:12.854743 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c02624ae-9d48-4393-a7d9-7bf18624b35c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:12.981389 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c02624ae-9d48-4393-a7d9-7bf18624b35c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:12.993570 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c02624ae-9d48-4393-a7d9-7bf18624b35c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:12.995168 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c02624ae-9d48-4393-a7d9-7bf18624b35c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:12.996413 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-c02624ae-9d48-4393-a7d9-7bf18624b35c tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1722 microversion: 2.20 time: 0.154357 Oct 12 04:23:12.997066 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 436/884] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:23:12 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:23:13.972453 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-248ba2ff-2575-468e-ae37-2154906f4a7d req-fab47faa-839a-483e-b00e-985d833d7954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12862c4a-cd3e-4b8e-91b3-9dbe108af390", "name": "network-vif-deleted", "tag": "5617efe3-71de-4588-bef7-3cd445452960"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:23:13.974019 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:23:13.974019 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:23:13.980941 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-248ba2ff-2575-468e-ae37-2154906f4a7d req-fab47faa-839a-483e-b00e-985d833d7954 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:13.981374 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-248ba2ff-2575-468e-ae37-2154906f4a7d req-fab47faa-839a-483e-b00e-985d833d7954 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:13.993105 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-248ba2ff-2575-468e-ae37-2154906f4a7d req-fab47faa-839a-483e-b00e-985d833d7954 service nova] Creating event network-vif-deleted:5617efe3-71de-4588-bef7-3cd445452960 for instance 12862c4a-cd3e-4b8e-91b3-9dbe108af390 on hv-cinder-81306 Oct 12 04:23:13.998814 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-248ba2ff-2575-468e-ae37-2154906f4a7d req-fab47faa-839a-483e-b00e-985d833d7954 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029945 Oct 12 04:23:13.999390 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 449/885] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:23:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:23:14.014851 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-f526b5a1-9eb1-4e79-b5a2-46505fda0004 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:14.018229 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-f526b5a1-9eb1-4e79-b5a2-46505fda0004 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:14.024595 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f526b5a1-9eb1-4e79-b5a2-46505fda0004 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:14.025247 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f526b5a1-9eb1-4e79-b5a2-46505fda0004 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:14.026027 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f526b5a1-9eb1-4e79-b5a2-46505fda0004 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:14.026459 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f526b5a1-9eb1-4e79-b5a2-46505fda0004 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:14.101909 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-f526b5a1-9eb1-4e79-b5a2-46505fda0004 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:14.111871 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-f526b5a1-9eb1-4e79-b5a2-46505fda0004 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:14.115121 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-f526b5a1-9eb1-4e79-b5a2-46505fda0004 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eacda2627f3a4e20a265952eb29b41d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94eb0d66d77a44dba68f16a5d05cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:14.117290 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-f526b5a1-9eb1-4e79-b5a2-46505fda0004 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 200 len: 1656 microversion: 2.20 time: 0.106153 Oct 12 04:23:14.119161 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 437/886] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:23:14 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 1656 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 04:23:15.138274 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-a5020fc1-ea17-4e19-afca-80d48efc777d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:15.139556 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-a5020fc1-ea17-4e19-afca-80d48efc777d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:15.145988 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a5020fc1-ea17-4e19-afca-80d48efc777d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:15.146460 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a5020fc1-ea17-4e19-afca-80d48efc777d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:15.147239 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a5020fc1-ea17-4e19-afca-80d48efc777d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:15.147666 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a5020fc1-ea17-4e19-afca-80d48efc777d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:15.160748 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.wsgi [None req-a5020fc1-ea17-4e19-afca-80d48efc777d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] HTTP exception thrown: Instance 12862c4a-cd3e-4b8e-91b3-9dbe108af390 could not be found. Oct 12 04:23:15.163251 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-a5020fc1-ea17-4e19-afca-80d48efc777d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Returning 404 to user: Instance 12862c4a-cd3e-4b8e-91b3-9dbe108af390 could not be found. {{(pid=108897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:23:15.163251 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-a5020fc1-ea17-4e19-afca-80d48efc777d tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 404 len: 111 microversion: 2.20 time: 0.029411 Oct 12 04:23:15.163251 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 450/887] 10.222.0.21 () {60 vars in 1276 bytes} [Tue Oct 12 04:23:15 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 04:23:15.173334 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-5a9da4c7-73a8-416c-8ba7-a21dc1ea5fff tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '.version_select at 0x7f38555cdb80>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:15.252506 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-5a9da4c7-73a8-416c-8ba7-a21dc1ea5fff tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-982511812" status: 204 len: 0 microversion: 2.20 time: 0.084965 Oct 12 04:23:15.253075 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 438/888] 10.222.0.21 () {60 vars in 1258 bytes} [Tue Oct 12 04:23:15 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-982511812 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 04:23:17.303406 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-e17c362b-4328-4e55-a04a-0ddd86a619ea tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:17.303894 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-e17c362b-4328-4e55-a04a-0ddd86a619ea tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:17.309531 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e17c362b-4328-4e55-a04a-0ddd86a619ea tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:17.309978 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e17c362b-4328-4e55-a04a-0ddd86a619ea tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:17.310776 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e17c362b-4328-4e55-a04a-0ddd86a619ea tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:17.311208 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e17c362b-4328-4e55-a04a-0ddd86a619ea tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:17.325036 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.wsgi [None req-e17c362b-4328-4e55-a04a-0ddd86a619ea tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] HTTP exception thrown: Instance 12862c4a-cd3e-4b8e-91b3-9dbe108af390 could not be found. Oct 12 04:23:17.325608 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-e17c362b-4328-4e55-a04a-0ddd86a619ea tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Returning 404 to user: Instance 12862c4a-cd3e-4b8e-91b3-9dbe108af390 could not be found. {{(pid=108897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:23:17.326405 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-e17c362b-4328-4e55-a04a-0ddd86a619ea tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "DELETE /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 404 len: 111 microversion: 2.1 time: 0.026639 Oct 12 04:23:17.326950 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 451/889] 10.222.0.21 () {58 vars in 1238 bytes} [Tue Oct 12 04:23:17 2021] DELETE /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 04:23:17.334795 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-2cd71664-7db8-4e30-893f-201a1119edf9 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:17.335400 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-2cd71664-7db8-4e30-893f-201a1119edf9 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 12862c4a-cd3e-4b8e-91b3-9dbe108af390] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:17.341118 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2cd71664-7db8-4e30-893f-201a1119edf9 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:17.341567 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2cd71664-7db8-4e30-893f-201a1119edf9 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:17.342836 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2cd71664-7db8-4e30-893f-201a1119edf9 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:17.343267 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2cd71664-7db8-4e30-893f-201a1119edf9 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:17.356202 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.wsgi [None req-2cd71664-7db8-4e30-893f-201a1119edf9 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] HTTP exception thrown: Instance 12862c4a-cd3e-4b8e-91b3-9dbe108af390 could not be found. Oct 12 04:23:17.356769 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-2cd71664-7db8-4e30-893f-201a1119edf9 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Returning 404 to user: Instance 12862c4a-cd3e-4b8e-91b3-9dbe108af390 could not be found. {{(pid=108898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:23:17.357564 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-2cd71664-7db8-4e30-893f-201a1119edf9 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390" status: 404 len: 111 microversion: 2.1 time: 0.026426 Oct 12 04:23:17.358746 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 439/890] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:23:17 2021] GET /compute/v2.1/servers/12862c4a-cd3e-4b8e-91b3-9dbe108af390 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:23:18.624524 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-fb2b53b4-14f4-420a-81a6-c296aecee451 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:18.625001 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-fb2b53b4-14f4-420a-81a6-c296aecee451 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:18.630682 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fb2b53b4-14f4-420a-81a6-c296aecee451 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:18.631147 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fb2b53b4-14f4-420a-81a6-c296aecee451 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:18.631902 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fb2b53b4-14f4-420a-81a6-c296aecee451 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:18.632326 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fb2b53b4-14f4-420a-81a6-c296aecee451 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:18.645525 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.wsgi [None req-fb2b53b4-14f4-420a-81a6-c296aecee451 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] HTTP exception thrown: Instance 29fcfae4-9349-4167-9403-9a4a20f346bd could not be found. Oct 12 04:23:18.646100 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-fb2b53b4-14f4-420a-81a6-c296aecee451 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Returning 404 to user: Instance 29fcfae4-9349-4167-9403-9a4a20f346bd could not be found. {{(pid=108897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:23:18.646927 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-fb2b53b4-14f4-420a-81a6-c296aecee451 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "DELETE /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 404 len: 111 microversion: 2.1 time: 0.026591 Oct 12 04:23:18.647433 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 452/891] 10.222.0.21 () {58 vars in 1238 bytes} [Tue Oct 12 04:23:18 2021] DELETE /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:23:18.655023 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-5decd986-b092-41f2-9c17-2222409a7c18 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:18.655633 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-5decd986-b092-41f2-9c17-2222409a7c18 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] [instance: 29fcfae4-9349-4167-9403-9a4a20f346bd] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:18.661410 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5decd986-b092-41f2-9c17-2222409a7c18 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:18.661856 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5decd986-b092-41f2-9c17-2222409a7c18 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:18.662618 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5decd986-b092-41f2-9c17-2222409a7c18 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:18.663074 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5decd986-b092-41f2-9c17-2222409a7c18 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:18.676105 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.wsgi [None req-5decd986-b092-41f2-9c17-2222409a7c18 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] HTTP exception thrown: Instance 29fcfae4-9349-4167-9403-9a4a20f346bd could not be found. Oct 12 04:23:18.676674 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-5decd986-b092-41f2-9c17-2222409a7c18 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] Returning 404 to user: Instance 29fcfae4-9349-4167-9403-9a4a20f346bd could not be found. {{(pid=108898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:23:18.677524 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-5decd986-b092-41f2-9c17-2222409a7c18 tempest-AttachVolumeShelveTestJSON-2044453812 tempest-AttachVolumeShelveTestJSON-2044453812-project] 10.222.0.21 "GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd" status: 404 len: 111 microversion: 2.1 time: 0.026060 Oct 12 04:23:18.678060 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 440/892] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:23:18 2021] GET /compute/v2.1/servers/29fcfae4-9349-4167-9403-9a4a20f346bd => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:23:30.123321 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-c2417212-9636-4c90-a0ef-c86a412fd72e tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-77812188", "imageRef": "bf8c5573-3890-45dc-aec8-b1ad89136f80", "flavorRef": "452"}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:23:30.173062 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.network.neutron [None req-c2417212-9636-4c90-a0ef-c86a412fd72e tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] validate_networks() for None {{(pid=108897) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 04:23:30.447686 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-c2417212-9636-4c90-a0ef-c86a412fd72e tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Flavor limits 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 04:23:30.448134 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-c2417212-9636-4c90-a0ef-c86a412fd72e tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Image limits 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 04:23:30.448607 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-c2417212-9636-4c90-a0ef-c86a412fd72e tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Flavor pref 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 04:23:30.449014 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-c2417212-9636-4c90-a0ef-c86a412fd72e tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Image pref 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 04:23:30.449428 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-c2417212-9636-4c90-a0ef-c86a412fd72e tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 04:23:30.459724 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c2417212-9636-4c90-a0ef-c86a412fd72e tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:30.460159 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c2417212-9636-4c90-a0ef-c86a412fd72e tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:30.461004 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c2417212-9636-4c90-a0ef-c86a412fd72e tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:30.461431 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c2417212-9636-4c90-a0ef-c86a412fd72e tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:30.477669 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-c2417212-9636-4c90-a0ef-c86a412fd72e tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Getting quotas for project fb88025825b7471f930996ad652df975. Resources: {'cores', 'instances', 'ram'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:23:30.481884 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-c2417212-9636-4c90-a0ef-c86a412fd72e tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Getting quotas for user 13541f2552f84dc68cb5cd3e87c52ca4 and project fb88025825b7471f930996ad652df975. Resources: {'cores', 'instances', 'ram'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:23:30.492788 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-c2417212-9636-4c90-a0ef-c86a412fd72e tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Going to run 1 instances... {{(pid=108897) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 04:23:30.495101 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-c2417212-9636-4c90-a0ef-c86a412fd72e tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf8c5573-3890-45dc-aec8-b1ad89136f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 04:23:30.871305 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-c2417212-9636-4c90-a0ef-c86a412fd72e tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.751808 Oct 12 04:23:30.871934 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 453/893] 10.222.0.21 () {60 vars in 1146 bytes} [Tue Oct 12 04:23:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 04:23:30.881775 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-ec012f98-0437-4899-8634-6bf4b55924e0 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:30.882374 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-ec012f98-0437-4899-8634-6bf4b55924e0 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:30.936612 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-ec012f98-0437-4899-8634-6bf4b55924e0 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13541f2552f84dc68cb5cd3e87c52ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb88025825b7471f930996ad652df975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:30.943476 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-ec012f98-0437-4899-8634-6bf4b55924e0 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] 10.222.0.21 "GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940" status: 200 len: 1213 microversion: 2.1 time: 0.065428 Oct 12 04:23:30.944308 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 441/894] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:23:30 2021] GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940 => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:23:31.959939 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-2bda6754-db7a-43d6-8439-ec05c3576033 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:31.960459 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-2bda6754-db7a-43d6-8439-ec05c3576033 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:31.966784 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2bda6754-db7a-43d6-8439-ec05c3576033 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:31.967224 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2bda6754-db7a-43d6-8439-ec05c3576033 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:31.967989 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2bda6754-db7a-43d6-8439-ec05c3576033 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:31.968416 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2bda6754-db7a-43d6-8439-ec05c3576033 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:32.029686 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-2bda6754-db7a-43d6-8439-ec05c3576033 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13541f2552f84dc68cb5cd3e87c52ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb88025825b7471f930996ad652df975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:32.037327 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-2bda6754-db7a-43d6-8439-ec05c3576033 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] 10.222.0.21 "GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940" status: 200 len: 1217 microversion: 2.1 time: 0.081167 Oct 12 04:23:32.037893 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 454/895] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:23:31 2021] GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940 => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:23:33.055620 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-00a61a0f-896f-4059-a830-c7cb7d3413ee tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:33.056255 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-00a61a0f-896f-4059-a830-c7cb7d3413ee tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:33.062542 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-00a61a0f-896f-4059-a830-c7cb7d3413ee tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:33.063029 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-00a61a0f-896f-4059-a830-c7cb7d3413ee tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:33.063765 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-00a61a0f-896f-4059-a830-c7cb7d3413ee tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:33.064188 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-00a61a0f-896f-4059-a830-c7cb7d3413ee tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:33.121890 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-00a61a0f-896f-4059-a830-c7cb7d3413ee tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13541f2552f84dc68cb5cd3e87c52ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb88025825b7471f930996ad652df975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:33.129509 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-00a61a0f-896f-4059-a830-c7cb7d3413ee tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] 10.222.0.21 "GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940" status: 200 len: 1217 microversion: 2.1 time: 0.077527 Oct 12 04:23:33.130056 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 442/896] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:23:33 2021] GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940 => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:23:34.145983 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ee1dbb2d-9236-47d6-aae8-5eeeeafac016 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:34.146584 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ee1dbb2d-9236-47d6-aae8-5eeeeafac016 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:34.152401 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ee1dbb2d-9236-47d6-aae8-5eeeeafac016 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:34.152851 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ee1dbb2d-9236-47d6-aae8-5eeeeafac016 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:34.153605 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ee1dbb2d-9236-47d6-aae8-5eeeeafac016 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:34.154037 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ee1dbb2d-9236-47d6-aae8-5eeeeafac016 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:34.210535 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-ee1dbb2d-9236-47d6-aae8-5eeeeafac016 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13541f2552f84dc68cb5cd3e87c52ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb88025825b7471f930996ad652df975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:34.217478 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ee1dbb2d-9236-47d6-aae8-5eeeeafac016 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] 10.222.0.21 "GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940" status: 200 len: 1209 microversion: 2.1 time: 0.075140 Oct 12 04:23:34.218067 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 455/897] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:23:34 2021] GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940 => generated 1209 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:23:35.235329 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-edfc3f8a-8b4b-4678-b43c-0252736f999e tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:35.236380 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-edfc3f8a-8b4b-4678-b43c-0252736f999e tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:35.244860 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-edfc3f8a-8b4b-4678-b43c-0252736f999e tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:35.249197 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-edfc3f8a-8b4b-4678-b43c-0252736f999e tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:35.249197 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-edfc3f8a-8b4b-4678-b43c-0252736f999e tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:35.249197 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-edfc3f8a-8b4b-4678-b43c-0252736f999e tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:35.307521 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-edfc3f8a-8b4b-4678-b43c-0252736f999e tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13541f2552f84dc68cb5cd3e87c52ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb88025825b7471f930996ad652df975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:35.315409 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-edfc3f8a-8b4b-4678-b43c-0252736f999e tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] 10.222.0.21 "GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940" status: 200 len: 1273 microversion: 2.1 time: 0.083865 Oct 12 04:23:35.316017 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 443/898] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:23:35 2021] GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940 => generated 1273 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:23:36.333021 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-e3167759-e1f9-4bf0-9167-c67543dc9744 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:36.333632 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-e3167759-e1f9-4bf0-9167-c67543dc9744 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:36.340211 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e3167759-e1f9-4bf0-9167-c67543dc9744 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:36.341937 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e3167759-e1f9-4bf0-9167-c67543dc9744 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:36.341937 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e3167759-e1f9-4bf0-9167-c67543dc9744 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:36.342147 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e3167759-e1f9-4bf0-9167-c67543dc9744 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:36.477996 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-e3167759-e1f9-4bf0-9167-c67543dc9744 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13541f2552f84dc68cb5cd3e87c52ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb88025825b7471f930996ad652df975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:36.485951 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-e3167759-e1f9-4bf0-9167-c67543dc9744 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] 10.222.0.21 "GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940" status: 200 len: 1313 microversion: 2.1 time: 0.157035 Oct 12 04:23:36.486513 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 456/899] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:23:36 2021] GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:23:37.194276 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-cb228805-1ef6-4d4d-b689-9bc17dc7305a req-51f19ced-aa66-47cc-b7e8-e235a8feb9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c94fcc-d1a8-4f51-bc55-6435a2137940", "tag": "c780838e-4a0f-4bca-a2c0-ccfa98563e43"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:23:37.195890 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:23:37.195890 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:23:37.202530 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-cb228805-1ef6-4d4d-b689-9bc17dc7305a req-51f19ced-aa66-47cc-b7e8-e235a8feb9d8 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:37.203829 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-cb228805-1ef6-4d4d-b689-9bc17dc7305a req-51f19ced-aa66-47cc-b7e8-e235a8feb9d8 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:37.216030 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-cb228805-1ef6-4d4d-b689-9bc17dc7305a req-51f19ced-aa66-47cc-b7e8-e235a8feb9d8 service nova] Creating event network-changed:c780838e-4a0f-4bca-a2c0-ccfa98563e43 for instance b8c94fcc-d1a8-4f51-bc55-6435a2137940 on hv-cinder-81306 Oct 12 04:23:37.221061 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-cb228805-1ef6-4d4d-b689-9bc17dc7305a req-51f19ced-aa66-47cc-b7e8-e235a8feb9d8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030478 Oct 12 04:23:37.221658 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 444/900] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:23:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:23:37.502686 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-b186e7bb-6928-4d24-bbae-267d18741519 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:37.503304 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-b186e7bb-6928-4d24-bbae-267d18741519 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:37.509177 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b186e7bb-6928-4d24-bbae-267d18741519 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:37.509563 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b186e7bb-6928-4d24-bbae-267d18741519 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:37.510416 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b186e7bb-6928-4d24-bbae-267d18741519 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:37.510876 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b186e7bb-6928-4d24-bbae-267d18741519 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:37.630041 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-b186e7bb-6928-4d24-bbae-267d18741519 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13541f2552f84dc68cb5cd3e87c52ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb88025825b7471f930996ad652df975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:37.637071 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-b186e7bb-6928-4d24-bbae-267d18741519 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] 10.222.0.21 "GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940" status: 200 len: 1313 microversion: 2.1 time: 0.138120 Oct 12 04:23:37.637617 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 457/901] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:23:37 2021] GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940 => generated 1313 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:23:38.653375 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-8efb10ed-05bf-4506-b01a-5cdc1b348e02 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:38.653992 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-8efb10ed-05bf-4506-b01a-5cdc1b348e02 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:38.660349 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8efb10ed-05bf-4506-b01a-5cdc1b348e02 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:38.660794 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8efb10ed-05bf-4506-b01a-5cdc1b348e02 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:38.661543 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8efb10ed-05bf-4506-b01a-5cdc1b348e02 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:38.661966 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8efb10ed-05bf-4506-b01a-5cdc1b348e02 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:38.777560 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-8efb10ed-05bf-4506-b01a-5cdc1b348e02 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13541f2552f84dc68cb5cd3e87c52ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb88025825b7471f930996ad652df975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:38.784559 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-8efb10ed-05bf-4506-b01a-5cdc1b348e02 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] 10.222.0.21 "GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940" status: 200 len: 1313 microversion: 2.1 time: 0.135253 Oct 12 04:23:38.785106 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 445/902] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:23:38 2021] GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940 => generated 1313 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:23:39.801126 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-408597d2-c36c-4026-96a2-424d93ff1de1 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:39.801871 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-408597d2-c36c-4026-96a2-424d93ff1de1 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:39.807601 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-408597d2-c36c-4026-96a2-424d93ff1de1 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:39.808079 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-408597d2-c36c-4026-96a2-424d93ff1de1 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:39.808813 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-408597d2-c36c-4026-96a2-424d93ff1de1 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:39.809247 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-408597d2-c36c-4026-96a2-424d93ff1de1 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:39.929891 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-408597d2-c36c-4026-96a2-424d93ff1de1 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13541f2552f84dc68cb5cd3e87c52ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb88025825b7471f930996ad652df975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:39.936989 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-408597d2-c36c-4026-96a2-424d93ff1de1 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] 10.222.0.21 "GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940" status: 200 len: 1313 microversion: 2.1 time: 0.139534 Oct 12 04:23:39.937545 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 458/903] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:23:39 2021] GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940 => generated 1313 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:23:40.954715 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-5ab2edd1-548f-4d1c-a168-533687761ff8 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:40.955264 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-5ab2edd1-548f-4d1c-a168-533687761ff8 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:40.961051 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5ab2edd1-548f-4d1c-a168-533687761ff8 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:40.961492 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5ab2edd1-548f-4d1c-a168-533687761ff8 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:40.962247 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5ab2edd1-548f-4d1c-a168-533687761ff8 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:40.962696 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5ab2edd1-548f-4d1c-a168-533687761ff8 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:41.082481 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-5ab2edd1-548f-4d1c-a168-533687761ff8 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13541f2552f84dc68cb5cd3e87c52ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb88025825b7471f930996ad652df975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:41.089562 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-5ab2edd1-548f-4d1c-a168-533687761ff8 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] 10.222.0.21 "GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940" status: 200 len: 1313 microversion: 2.1 time: 0.139107 Oct 12 04:23:41.090114 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 446/904] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:23:40 2021] GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940 => generated 1313 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:23:42.107098 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-4ba89e3f-fa6c-47b9-b051-3e1e8089f831 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:42.107707 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-4ba89e3f-fa6c-47b9-b051-3e1e8089f831 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:42.114036 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4ba89e3f-fa6c-47b9-b051-3e1e8089f831 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:42.114484 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4ba89e3f-fa6c-47b9-b051-3e1e8089f831 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:42.115290 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4ba89e3f-fa6c-47b9-b051-3e1e8089f831 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:42.115725 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4ba89e3f-fa6c-47b9-b051-3e1e8089f831 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:42.236545 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-4ba89e3f-fa6c-47b9-b051-3e1e8089f831 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13541f2552f84dc68cb5cd3e87c52ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb88025825b7471f930996ad652df975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:42.243652 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-4ba89e3f-fa6c-47b9-b051-3e1e8089f831 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] 10.222.0.21 "GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940" status: 200 len: 1313 microversion: 2.1 time: 0.140480 Oct 12 04:23:42.244228 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 459/905] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:23:42 2021] GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940 => generated 1313 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:23:43.260829 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-25d46082-c4c6-48ae-94b5-b0e1fb2418b7 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:43.261373 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-25d46082-c4c6-48ae-94b5-b0e1fb2418b7 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:43.267756 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-25d46082-c4c6-48ae-94b5-b0e1fb2418b7 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:43.271545 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-25d46082-c4c6-48ae-94b5-b0e1fb2418b7 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:43.271545 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-25d46082-c4c6-48ae-94b5-b0e1fb2418b7 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:43.271545 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-25d46082-c4c6-48ae-94b5-b0e1fb2418b7 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:43.393359 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-25d46082-c4c6-48ae-94b5-b0e1fb2418b7 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13541f2552f84dc68cb5cd3e87c52ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb88025825b7471f930996ad652df975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:43.400560 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-25d46082-c4c6-48ae-94b5-b0e1fb2418b7 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] 10.222.0.21 "GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940" status: 200 len: 1313 microversion: 2.1 time: 0.143490 Oct 12 04:23:43.401119 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 447/906] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:23:43 2021] GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940 => generated 1313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:23:44.417231 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-fcfba568-999d-48ac-8167-da033e18b716 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:44.417834 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-fcfba568-999d-48ac-8167-da033e18b716 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:44.424244 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fcfba568-999d-48ac-8167-da033e18b716 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:44.424690 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fcfba568-999d-48ac-8167-da033e18b716 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:44.425440 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fcfba568-999d-48ac-8167-da033e18b716 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:44.425867 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fcfba568-999d-48ac-8167-da033e18b716 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:44.547940 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-fcfba568-999d-48ac-8167-da033e18b716 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13541f2552f84dc68cb5cd3e87c52ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb88025825b7471f930996ad652df975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:44.554930 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-fcfba568-999d-48ac-8167-da033e18b716 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] 10.222.0.21 "GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940" status: 200 len: 1313 microversion: 2.1 time: 0.141309 Oct 12 04:23:44.555480 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 460/907] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:23:44 2021] GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940 => generated 1313 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:23:45.571323 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-e15189a1-3615-4d18-8009-9ced1a319ace tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:45.571926 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-e15189a1-3615-4d18-8009-9ced1a319ace tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:45.577673 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e15189a1-3615-4d18-8009-9ced1a319ace tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:45.578108 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e15189a1-3615-4d18-8009-9ced1a319ace tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:45.578909 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e15189a1-3615-4d18-8009-9ced1a319ace tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:45.579336 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e15189a1-3615-4d18-8009-9ced1a319ace tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:45.698201 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-e15189a1-3615-4d18-8009-9ced1a319ace tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13541f2552f84dc68cb5cd3e87c52ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb88025825b7471f930996ad652df975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:45.705263 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-e15189a1-3615-4d18-8009-9ced1a319ace tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] 10.222.0.21 "GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940" status: 200 len: 1313 microversion: 2.1 time: 0.137548 Oct 12 04:23:45.705825 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 448/908] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:23:45 2021] GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940 => generated 1313 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:23:46.722442 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-f45ddc6b-b36c-4c70-b7c2-50a2400f1af1 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:46.723084 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-f45ddc6b-b36c-4c70-b7c2-50a2400f1af1 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:46.729456 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f45ddc6b-b36c-4c70-b7c2-50a2400f1af1 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:46.729915 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f45ddc6b-b36c-4c70-b7c2-50a2400f1af1 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:46.730985 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f45ddc6b-b36c-4c70-b7c2-50a2400f1af1 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:46.731428 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f45ddc6b-b36c-4c70-b7c2-50a2400f1af1 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:46.856996 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-f45ddc6b-b36c-4c70-b7c2-50a2400f1af1 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13541f2552f84dc68cb5cd3e87c52ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb88025825b7471f930996ad652df975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:46.864495 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-f45ddc6b-b36c-4c70-b7c2-50a2400f1af1 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] 10.222.0.21 "GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940" status: 200 len: 1313 microversion: 2.1 time: 0.145835 Oct 12 04:23:46.865039 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 461/909] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:23:46 2021] GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:23:47.719166 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-880e0e83-e46f-45c5-b210-4f70d84b1a6a req-5e899756-56da-4ecc-b26b-9bc3db53cfb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c94fcc-d1a8-4f51-bc55-6435a2137940", "name": "network-vif-plugged", "status": "completed", "tag": "c780838e-4a0f-4bca-a2c0-ccfa98563e43"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:23:47.721618 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:23:47.721618 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:23:47.728185 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-880e0e83-e46f-45c5-b210-4f70d84b1a6a req-5e899756-56da-4ecc-b26b-9bc3db53cfb1 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:47.728613 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-880e0e83-e46f-45c5-b210-4f70d84b1a6a req-5e899756-56da-4ecc-b26b-9bc3db53cfb1 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:47.739711 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-880e0e83-e46f-45c5-b210-4f70d84b1a6a req-5e899756-56da-4ecc-b26b-9bc3db53cfb1 service nova] Creating event network-vif-plugged:c780838e-4a0f-4bca-a2c0-ccfa98563e43 for instance b8c94fcc-d1a8-4f51-bc55-6435a2137940 on hv-cinder-81306 Oct 12 04:23:47.744670 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-880e0e83-e46f-45c5-b210-4f70d84b1a6a req-5e899756-56da-4ecc-b26b-9bc3db53cfb1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029050 Oct 12 04:23:47.745204 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 449/910] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:23:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:23:47.881371 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-dbc3353b-54e8-4809-9371-cc3348770d5f tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:47.882090 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-dbc3353b-54e8-4809-9371-cc3348770d5f tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:47.888550 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-dbc3353b-54e8-4809-9371-cc3348770d5f tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:47.893139 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-dbc3353b-54e8-4809-9371-cc3348770d5f tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:47.893139 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-dbc3353b-54e8-4809-9371-cc3348770d5f tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:47.893139 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-dbc3353b-54e8-4809-9371-cc3348770d5f tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:48.019118 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-dbc3353b-54e8-4809-9371-cc3348770d5f tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13541f2552f84dc68cb5cd3e87c52ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb88025825b7471f930996ad652df975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:48.026474 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-dbc3353b-54e8-4809-9371-cc3348770d5f tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] 10.222.0.21 "GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940" status: 200 len: 1313 microversion: 2.1 time: 0.148763 Oct 12 04:23:48.027064 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 462/911] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:23:47 2021] GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:23:49.042656 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-639a3c1e-b08a-4f76-ba62-1ce4864cfe5c tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:49.043379 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-639a3c1e-b08a-4f76-ba62-1ce4864cfe5c tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:49.049362 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-639a3c1e-b08a-4f76-ba62-1ce4864cfe5c tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:49.049805 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-639a3c1e-b08a-4f76-ba62-1ce4864cfe5c tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:49.050558 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-639a3c1e-b08a-4f76-ba62-1ce4864cfe5c tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:49.051013 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-639a3c1e-b08a-4f76-ba62-1ce4864cfe5c tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:49.170982 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-639a3c1e-b08a-4f76-ba62-1ce4864cfe5c tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13541f2552f84dc68cb5cd3e87c52ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb88025825b7471f930996ad652df975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:49.177991 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-639a3c1e-b08a-4f76-ba62-1ce4864cfe5c tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] 10.222.0.21 "GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940" status: 200 len: 1313 microversion: 2.1 time: 0.139291 Oct 12 04:23:49.178542 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 450/912] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:23:49 2021] GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940 => generated 1313 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:23:50.193612 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-be79fb13-92b2-45f3-af3d-4dfe5478131f tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:50.194219 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-be79fb13-92b2-45f3-af3d-4dfe5478131f tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:50.199988 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-be79fb13-92b2-45f3-af3d-4dfe5478131f tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:50.200437 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-be79fb13-92b2-45f3-af3d-4dfe5478131f tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:50.201186 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-be79fb13-92b2-45f3-af3d-4dfe5478131f tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:50.201623 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-be79fb13-92b2-45f3-af3d-4dfe5478131f tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:50.323892 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-be79fb13-92b2-45f3-af3d-4dfe5478131f tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13541f2552f84dc68cb5cd3e87c52ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb88025825b7471f930996ad652df975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:50.331045 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-be79fb13-92b2-45f3-af3d-4dfe5478131f tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] 10.222.0.21 "GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940" status: 200 len: 1313 microversion: 2.1 time: 0.141016 Oct 12 04:23:50.331592 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 463/913] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:23:50 2021] GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940 => generated 1313 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:23:51.347616 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-9d0cf618-f8b8-41d3-b336-3ca4faef14f8 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:51.348219 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-9d0cf618-f8b8-41d3-b336-3ca4faef14f8 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:51.354035 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9d0cf618-f8b8-41d3-b336-3ca4faef14f8 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:51.354477 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9d0cf618-f8b8-41d3-b336-3ca4faef14f8 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:51.355520 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9d0cf618-f8b8-41d3-b336-3ca4faef14f8 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:51.355947 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9d0cf618-f8b8-41d3-b336-3ca4faef14f8 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:51.471296 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-9d0cf618-f8b8-41d3-b336-3ca4faef14f8 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13541f2552f84dc68cb5cd3e87c52ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb88025825b7471f930996ad652df975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:51.478484 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-9d0cf618-f8b8-41d3-b336-3ca4faef14f8 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] 10.222.0.21 "GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940" status: 200 len: 1313 microversion: 2.1 time: 0.134553 Oct 12 04:23:51.479068 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 451/914] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:23:51 2021] GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940 => generated 1313 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:23:52.495612 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-087fe9ac-9194-4c88-a550-c50a578ab7e3 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:52.496202 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-087fe9ac-9194-4c88-a550-c50a578ab7e3 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:52.502308 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-087fe9ac-9194-4c88-a550-c50a578ab7e3 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:52.502773 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-087fe9ac-9194-4c88-a550-c50a578ab7e3 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:52.503523 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-087fe9ac-9194-4c88-a550-c50a578ab7e3 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:52.503950 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-087fe9ac-9194-4c88-a550-c50a578ab7e3 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:52.620174 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-087fe9ac-9194-4c88-a550-c50a578ab7e3 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13541f2552f84dc68cb5cd3e87c52ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb88025825b7471f930996ad652df975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:52.627862 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-087fe9ac-9194-4c88-a550-c50a578ab7e3 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] 10.222.0.21 "GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940" status: 200 len: 1462 microversion: 2.1 time: 0.135985 Oct 12 04:23:52.628412 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 464/915] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:23:52 2021] GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940 => generated 1462 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:23:52.664104 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-5e4a223f-b27e-4ab4-8c3f-4a2ef66318a9 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:52.664597 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-5e4a223f-b27e-4ab4-8c3f-4a2ef66318a9 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:52.670477 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5e4a223f-b27e-4ab4-8c3f-4a2ef66318a9 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:52.670950 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5e4a223f-b27e-4ab4-8c3f-4a2ef66318a9 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:52.671699 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5e4a223f-b27e-4ab4-8c3f-4a2ef66318a9 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:52.672119 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5e4a223f-b27e-4ab4-8c3f-4a2ef66318a9 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:52.695831 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-5e4a223f-b27e-4ab4-8c3f-4a2ef66318a9 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] Going to try to terminate instance {{(pid=108898) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 04:23:52.959223 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-5e4a223f-b27e-4ab4-8c3f-4a2ef66318a9 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] 10.222.0.21 "DELETE /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940" status: 204 len: 0 microversion: 2.1 time: 0.298420 Oct 12 04:23:52.959755 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 452/916] 10.222.0.21 () {58 vars in 1238 bytes} [Tue Oct 12 04:23:52 2021] DELETE /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 04:23:52.967667 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-7c07c4f8-0373-4e38-aa11-7124c8d451f2 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:52.968492 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-7c07c4f8-0373-4e38-aa11-7124c8d451f2 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:52.974960 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7c07c4f8-0373-4e38-aa11-7124c8d451f2 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:52.975421 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7c07c4f8-0373-4e38-aa11-7124c8d451f2 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:52.981056 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7c07c4f8-0373-4e38-aa11-7124c8d451f2 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:52.981056 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7c07c4f8-0373-4e38-aa11-7124c8d451f2 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:53.096678 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-7c07c4f8-0373-4e38-aa11-7124c8d451f2 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13541f2552f84dc68cb5cd3e87c52ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb88025825b7471f930996ad652df975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:53.103720 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-7c07c4f8-0373-4e38-aa11-7124c8d451f2 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] 10.222.0.21 "GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940" status: 200 len: 1468 microversion: 2.1 time: 0.139696 Oct 12 04:23:53.104261 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 465/917] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:23:52 2021] GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940 => generated 1468 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:23:54.122735 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-5c26f010-df85-4775-ad0b-7f58375c8db8 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:54.123441 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-5c26f010-df85-4775-ad0b-7f58375c8db8 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:54.129757 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5c26f010-df85-4775-ad0b-7f58375c8db8 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:54.130139 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5c26f010-df85-4775-ad0b-7f58375c8db8 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:54.130944 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5c26f010-df85-4775-ad0b-7f58375c8db8 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:54.131437 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5c26f010-df85-4775-ad0b-7f58375c8db8 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:54.253255 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-5c26f010-df85-4775-ad0b-7f58375c8db8 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13541f2552f84dc68cb5cd3e87c52ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb88025825b7471f930996ad652df975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:54.260445 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-5c26f010-df85-4775-ad0b-7f58375c8db8 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] 10.222.0.21 "GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940" status: 200 len: 1468 microversion: 2.1 time: 0.141995 Oct 12 04:23:54.261001 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 453/918] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:23:54 2021] GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940 => generated 1468 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:23:55.277997 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-302fb5aa-23c1-4b73-97b4-9188018d5059 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:55.278529 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-302fb5aa-23c1-4b73-97b4-9188018d5059 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:55.285102 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-302fb5aa-23c1-4b73-97b4-9188018d5059 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:55.294764 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-302fb5aa-23c1-4b73-97b4-9188018d5059 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:55.294764 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-302fb5aa-23c1-4b73-97b4-9188018d5059 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:55.294764 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-302fb5aa-23c1-4b73-97b4-9188018d5059 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:55.402996 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-302fb5aa-23c1-4b73-97b4-9188018d5059 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13541f2552f84dc68cb5cd3e87c52ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb88025825b7471f930996ad652df975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:55.410127 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-302fb5aa-23c1-4b73-97b4-9188018d5059 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] 10.222.0.21 "GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940" status: 200 len: 1468 microversion: 2.1 time: 0.135906 Oct 12 04:23:55.410697 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 466/919] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:23:55 2021] GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940 => generated 1468 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:23:56.427486 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d72de276-f7ce-4b4d-b786-f7152082b491 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:56.428087 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-d72de276-f7ce-4b4d-b786-f7152082b491 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:56.433833 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d72de276-f7ce-4b4d-b786-f7152082b491 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:56.434278 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d72de276-f7ce-4b4d-b786-f7152082b491 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:56.435179 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d72de276-f7ce-4b4d-b786-f7152082b491 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:56.435608 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d72de276-f7ce-4b4d-b786-f7152082b491 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:56.554483 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-d72de276-f7ce-4b4d-b786-f7152082b491 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13541f2552f84dc68cb5cd3e87c52ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb88025825b7471f930996ad652df975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:56.561594 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-d72de276-f7ce-4b4d-b786-f7152082b491 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] 10.222.0.21 "GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940" status: 200 len: 1468 microversion: 2.1 time: 0.137781 Oct 12 04:23:56.562141 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 454/920] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:23:56 2021] GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940 => generated 1468 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:23:57.553857 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-84198b18-ec75-4d53-b186-13680ef018d3 req-2bf7b0b7-beb5-47e0-8cf7-bb09c6adc580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c94fcc-d1a8-4f51-bc55-6435a2137940", "name": "network-vif-deleted", "tag": "c780838e-4a0f-4bca-a2c0-ccfa98563e43"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:23:57.555457 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:23:57.555457 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:23:57.562496 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-84198b18-ec75-4d53-b186-13680ef018d3 req-2bf7b0b7-beb5-47e0-8cf7-bb09c6adc580 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:57.563570 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-84198b18-ec75-4d53-b186-13680ef018d3 req-2bf7b0b7-beb5-47e0-8cf7-bb09c6adc580 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:57.575430 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-84198b18-ec75-4d53-b186-13680ef018d3 req-2bf7b0b7-beb5-47e0-8cf7-bb09c6adc580 service nova] Creating event network-vif-deleted:c780838e-4a0f-4bca-a2c0-ccfa98563e43 for instance b8c94fcc-d1a8-4f51-bc55-6435a2137940 on hv-cinder-81306 Oct 12 04:23:57.578698 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-0e965f23-7d4e-43b6-8b89-2bfda80b7c68 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:57.579419 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-0e965f23-7d4e-43b6-8b89-2bfda80b7c68 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:57.580849 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-84198b18-ec75-4d53-b186-13680ef018d3 req-2bf7b0b7-beb5-47e0-8cf7-bb09c6adc580 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030549 Oct 12 04:23:57.581673 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 467/921] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:23:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:23:57.589994 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0e965f23-7d4e-43b6-8b89-2bfda80b7c68 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:57.589994 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0e965f23-7d4e-43b6-8b89-2bfda80b7c68 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:57.589994 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0e965f23-7d4e-43b6-8b89-2bfda80b7c68 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:57.589994 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0e965f23-7d4e-43b6-8b89-2bfda80b7c68 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:57.651832 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-0e965f23-7d4e-43b6-8b89-2bfda80b7c68 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13541f2552f84dc68cb5cd3e87c52ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb88025825b7471f930996ad652df975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:23:57.660011 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-0e965f23-7d4e-43b6-8b89-2bfda80b7c68 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] 10.222.0.21 "GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940" status: 200 len: 1426 microversion: 2.1 time: 0.085387 Oct 12 04:23:57.660587 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 455/922] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:23:57 2021] GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940 => generated 1426 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:23:58.677701 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-7f2e1830-1403-4b0b-84a2-ddd62cc4f4b9 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:23:58.678390 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-7f2e1830-1403-4b0b-84a2-ddd62cc4f4b9 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] [instance: b8c94fcc-d1a8-4f51-bc55-6435a2137940] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:23:58.684322 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7f2e1830-1403-4b0b-84a2-ddd62cc4f4b9 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:58.684763 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7f2e1830-1403-4b0b-84a2-ddd62cc4f4b9 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:58.685510 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7f2e1830-1403-4b0b-84a2-ddd62cc4f4b9 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:23:58.685938 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7f2e1830-1403-4b0b-84a2-ddd62cc4f4b9 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:23:58.699065 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.wsgi [None req-7f2e1830-1403-4b0b-84a2-ddd62cc4f4b9 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] HTTP exception thrown: Instance b8c94fcc-d1a8-4f51-bc55-6435a2137940 could not be found. Oct 12 04:23:58.699642 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-7f2e1830-1403-4b0b-84a2-ddd62cc4f4b9 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] Returning 404 to user: Instance b8c94fcc-d1a8-4f51-bc55-6435a2137940 could not be found. {{(pid=108897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:23:58.700437 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-7f2e1830-1403-4b0b-84a2-ddd62cc4f4b9 tempest-VolumesNegativeTest-630257736 tempest-VolumesNegativeTest-630257736-project] 10.222.0.21 "GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940" status: 404 len: 111 microversion: 2.1 time: 0.026899 Oct 12 04:23:58.700949 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 468/923] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:23:58 2021] GET /compute/v2.1/servers/b8c94fcc-d1a8-4f51-bc55-6435a2137940 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:24:04.050562 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 04:24:04.051243 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: Tue Oct 12 04:24:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 12 04:24:16.489291 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-0c5b1c74-d6ba-4674-987e-71ea9cef9328 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:24:16.490029 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-0c5b1c74-d6ba-4674-987e-71ea9cef9328 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:16.496004 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0c5b1c74-d6ba-4674-987e-71ea9cef9328 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:16.496456 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0c5b1c74-d6ba-4674-987e-71ea9cef9328 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:16.497222 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0c5b1c74-d6ba-4674-987e-71ea9cef9328 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:16.497645 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0c5b1c74-d6ba-4674-987e-71ea9cef9328 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:16.519135 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.objects.instance [None req-0c5b1c74-d6ba-4674-987e-71ea9cef9328 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lazy-loading 'flavor' on Instance uuid 2e51919f-b58c-4be5-8869-721e03482c90 {{(pid=108898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:24:16.718265 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-0c5b1c74-d6ba-4674-987e-71ea9cef9328 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "POST /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90/action" status: 202 len: 0 microversion: 2.1 time: 0.233349 Oct 12 04:24:16.718782 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 456/924] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:24:16 2021] POST /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:24:16.730785 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-987025d4-ccf4-4f86-ba7f-76225665dee1 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:16.742505 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-987025d4-ccf4-4f86-ba7f-76225665dee1 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:16.746050 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-987025d4-ccf4-4f86-ba7f-76225665dee1 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:16.746564 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-987025d4-ccf4-4f86-ba7f-76225665dee1 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:16.747705 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-987025d4-ccf4-4f86-ba7f-76225665dee1 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:16.748144 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-987025d4-ccf4-4f86-ba7f-76225665dee1 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:16.881951 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-987025d4-ccf4-4f86-ba7f-76225665dee1 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:16.889171 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-987025d4-ccf4-4f86-ba7f-76225665dee1 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1568 microversion: 2.1 time: 0.165091 Oct 12 04:24:16.889714 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 469/925] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:16 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:17.907184 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-da3f4edc-bc8a-48a2-aaf6-fb9d134f9aca tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:17.907879 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-da3f4edc-bc8a-48a2-aaf6-fb9d134f9aca tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:17.914426 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-da3f4edc-bc8a-48a2-aaf6-fb9d134f9aca tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:17.914904 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-da3f4edc-bc8a-48a2-aaf6-fb9d134f9aca tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:17.915662 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-da3f4edc-bc8a-48a2-aaf6-fb9d134f9aca tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:17.916092 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-da3f4edc-bc8a-48a2-aaf6-fb9d134f9aca tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:18.037557 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-da3f4edc-bc8a-48a2-aaf6-fb9d134f9aca tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:18.044704 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-da3f4edc-bc8a-48a2-aaf6-fb9d134f9aca tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1568 microversion: 2.1 time: 0.141561 Oct 12 04:24:18.045264 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 457/926] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:17 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:19.062328 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-4efb141a-5523-492a-9489-1fd25c279ea6 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:19.062950 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-4efb141a-5523-492a-9489-1fd25c279ea6 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:19.069213 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4efb141a-5523-492a-9489-1fd25c279ea6 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:19.069655 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4efb141a-5523-492a-9489-1fd25c279ea6 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:19.070401 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4efb141a-5523-492a-9489-1fd25c279ea6 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:19.070871 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4efb141a-5523-492a-9489-1fd25c279ea6 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:19.188112 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-4efb141a-5523-492a-9489-1fd25c279ea6 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:19.195834 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-4efb141a-5523-492a-9489-1fd25c279ea6 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1568 microversion: 2.1 time: 0.137087 Oct 12 04:24:19.196380 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 470/927] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:19 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:20.212998 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-1256529b-5203-41c6-a9bb-cfd6cb713c4b tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:20.213614 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-1256529b-5203-41c6-a9bb-cfd6cb713c4b tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:20.219656 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1256529b-5203-41c6-a9bb-cfd6cb713c4b tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:20.220103 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1256529b-5203-41c6-a9bb-cfd6cb713c4b tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:20.220860 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1256529b-5203-41c6-a9bb-cfd6cb713c4b tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:20.221282 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1256529b-5203-41c6-a9bb-cfd6cb713c4b tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:20.343411 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-1256529b-5203-41c6-a9bb-cfd6cb713c4b tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:20.350946 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-1256529b-5203-41c6-a9bb-cfd6cb713c4b tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1568 microversion: 2.1 time: 0.141580 Oct 12 04:24:20.351503 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 458/928] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:20 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:21.367688 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-df752e21-f37c-4962-b788-b958ec840bfb tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:21.368311 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-df752e21-f37c-4962-b788-b958ec840bfb tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:21.374390 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-df752e21-f37c-4962-b788-b958ec840bfb tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:21.374889 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-df752e21-f37c-4962-b788-b958ec840bfb tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:21.375684 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-df752e21-f37c-4962-b788-b958ec840bfb tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:21.376233 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-df752e21-f37c-4962-b788-b958ec840bfb tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:21.498312 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-df752e21-f37c-4962-b788-b958ec840bfb tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:21.506175 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-df752e21-f37c-4962-b788-b958ec840bfb tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1568 microversion: 2.1 time: 0.142177 Oct 12 04:24:21.506748 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 471/929] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:21 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:22.523949 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-440b6762-d837-4057-95a6-06f163fb015f tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:22.524555 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-440b6762-d837-4057-95a6-06f163fb015f tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:22.530385 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-440b6762-d837-4057-95a6-06f163fb015f tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:22.530866 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-440b6762-d837-4057-95a6-06f163fb015f tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:22.531625 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-440b6762-d837-4057-95a6-06f163fb015f tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:22.532050 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-440b6762-d837-4057-95a6-06f163fb015f tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:22.653540 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-440b6762-d837-4057-95a6-06f163fb015f tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:22.661013 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-440b6762-d837-4057-95a6-06f163fb015f tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1568 microversion: 2.1 time: 0.140768 Oct 12 04:24:22.661718 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 459/930] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:22 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:23.678155 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-60e1eeaa-4ffb-4b13-b303-9d2a81ed4633 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:23.678796 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-60e1eeaa-4ffb-4b13-b303-9d2a81ed4633 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:23.684682 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-60e1eeaa-4ffb-4b13-b303-9d2a81ed4633 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:23.685124 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-60e1eeaa-4ffb-4b13-b303-9d2a81ed4633 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:23.685869 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-60e1eeaa-4ffb-4b13-b303-9d2a81ed4633 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:23.686307 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-60e1eeaa-4ffb-4b13-b303-9d2a81ed4633 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:23.806429 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-60e1eeaa-4ffb-4b13-b303-9d2a81ed4633 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:23.814010 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-60e1eeaa-4ffb-4b13-b303-9d2a81ed4633 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1568 microversion: 2.1 time: 0.139575 Oct 12 04:24:23.814552 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 472/931] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:23 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:24.832189 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-495792c0-0e4d-4733-a6dc-80c09f340ec2 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:24.832797 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-495792c0-0e4d-4733-a6dc-80c09f340ec2 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:24.838632 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-495792c0-0e4d-4733-a6dc-80c09f340ec2 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:24.839107 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-495792c0-0e4d-4733-a6dc-80c09f340ec2 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:24.839869 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-495792c0-0e4d-4733-a6dc-80c09f340ec2 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:24.840299 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-495792c0-0e4d-4733-a6dc-80c09f340ec2 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:24.960603 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-495792c0-0e4d-4733-a6dc-80c09f340ec2 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:24.968834 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-495792c0-0e4d-4733-a6dc-80c09f340ec2 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1568 microversion: 2.1 time: 0.139711 Oct 12 04:24:24.968834 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 460/932] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:24 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:25.986294 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-86ea3b6f-4388-4075-9917-2aeaf2016348 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:25.986897 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-86ea3b6f-4388-4075-9917-2aeaf2016348 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:25.993110 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-86ea3b6f-4388-4075-9917-2aeaf2016348 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:25.993559 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-86ea3b6f-4388-4075-9917-2aeaf2016348 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:25.994308 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-86ea3b6f-4388-4075-9917-2aeaf2016348 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:25.994762 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-86ea3b6f-4388-4075-9917-2aeaf2016348 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:26.120803 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-86ea3b6f-4388-4075-9917-2aeaf2016348 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:26.128097 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-86ea3b6f-4388-4075-9917-2aeaf2016348 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1568 microversion: 2.1 time: 0.145545 Oct 12 04:24:26.128648 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 473/933] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:25 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:27.145708 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-ae2c051d-9a78-4391-b597-1c625206e8f5 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:27.146361 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-ae2c051d-9a78-4391-b597-1c625206e8f5 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:27.152273 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ae2c051d-9a78-4391-b597-1c625206e8f5 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:27.152700 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ae2c051d-9a78-4391-b597-1c625206e8f5 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:27.153498 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ae2c051d-9a78-4391-b597-1c625206e8f5 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:27.154696 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ae2c051d-9a78-4391-b597-1c625206e8f5 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:27.327384 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-ae2c051d-9a78-4391-b597-1c625206e8f5 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:27.342989 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-ae2c051d-9a78-4391-b597-1c625206e8f5 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1568 microversion: 2.1 time: 0.201469 Oct 12 04:24:27.343562 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 461/934] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:27 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1568 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:28.359929 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-3bc49b92-15f3-4911-9ddf-4d8758c8590e tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:28.360756 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-3bc49b92-15f3-4911-9ddf-4d8758c8590e tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:28.366921 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3bc49b92-15f3-4911-9ddf-4d8758c8590e tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:28.367358 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3bc49b92-15f3-4911-9ddf-4d8758c8590e tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:28.368142 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3bc49b92-15f3-4911-9ddf-4d8758c8590e tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:28.368579 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3bc49b92-15f3-4911-9ddf-4d8758c8590e tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:28.502266 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-3bc49b92-15f3-4911-9ddf-4d8758c8590e tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:28.510775 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-3bc49b92-15f3-4911-9ddf-4d8758c8590e tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1568 microversion: 2.1 time: 0.154380 Oct 12 04:24:28.511350 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 474/935] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:28 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:29.528549 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-b1349379-f570-40fa-b9be-50a8f7e432f4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:29.529185 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-b1349379-f570-40fa-b9be-50a8f7e432f4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:29.535812 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b1349379-f570-40fa-b9be-50a8f7e432f4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:29.536251 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b1349379-f570-40fa-b9be-50a8f7e432f4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:29.537056 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b1349379-f570-40fa-b9be-50a8f7e432f4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:29.537488 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b1349379-f570-40fa-b9be-50a8f7e432f4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:29.693250 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-b1349379-f570-40fa-b9be-50a8f7e432f4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:29.700858 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-b1349379-f570-40fa-b9be-50a8f7e432f4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1568 microversion: 2.1 time: 0.176292 Oct 12 04:24:29.703503 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 462/936] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:29 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:30.716206 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c175fb9-c815-43ae-82fc-42b6c7387c8c] AMQP server on 10.222.0.21:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 04:24:30.719634 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-57d2ff30-b20a-4c84-a1f6-1701ff256642 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:30.720352 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-57d2ff30-b20a-4c84-a1f6-1701ff256642 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:30.727316 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-57d2ff30-b20a-4c84-a1f6-1701ff256642 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:30.727865 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-57d2ff30-b20a-4c84-a1f6-1701ff256642 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:30.728549 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-57d2ff30-b20a-4c84-a1f6-1701ff256642 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:30.728976 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-57d2ff30-b20a-4c84-a1f6-1701ff256642 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:31.013472 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-57d2ff30-b20a-4c84-a1f6-1701ff256642 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:31.021910 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-57d2ff30-b20a-4c84-a1f6-1701ff256642 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1569 microversion: 2.1 time: 0.307130 Oct 12 04:24:31.022466 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 475/937] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:30 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1569 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:31.038828 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-11858f1d-f7a1-48ae-bb94-7ccde2c990ba tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:24:31.039669 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-11858f1d-f7a1-48ae-bb94-7ccde2c990ba tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:31.045888 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-11858f1d-f7a1-48ae-bb94-7ccde2c990ba tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:31.046386 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-11858f1d-f7a1-48ae-bb94-7ccde2c990ba tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:31.047632 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-11858f1d-f7a1-48ae-bb94-7ccde2c990ba tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:31.048542 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-11858f1d-f7a1-48ae-bb94-7ccde2c990ba tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:31.287915 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-11858f1d-f7a1-48ae-bb94-7ccde2c990ba tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "POST /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90/action" status: 202 len: 0 microversion: 2.1 time: 0.253575 Oct 12 04:24:31.292570 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 463/938] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:24:31 2021] POST /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:24:31.297699 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-7006da46-3078-401a-82ae-27013d5ca3e1 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:31.298776 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-7006da46-3078-401a-82ae-27013d5ca3e1 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:31.305531 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7006da46-3078-401a-82ae-27013d5ca3e1 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:31.306510 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7006da46-3078-401a-82ae-27013d5ca3e1 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:31.308891 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7006da46-3078-401a-82ae-27013d5ca3e1 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:31.308891 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7006da46-3078-401a-82ae-27013d5ca3e1 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:31.742208 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c175fb9-c815-43ae-82fc-42b6c7387c8c] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 37132. Oct 12 04:24:31.820976 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-7006da46-3078-401a-82ae-27013d5ca3e1 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:31.828726 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-7006da46-3078-401a-82ae-27013d5ca3e1 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1517 microversion: 2.1 time: 0.534975 Oct 12 04:24:31.829387 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 476/939] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:31 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1517 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:24:32.845333 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-1647a0a4-cf25-4ca6-9338-744f9e76943f tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:32.845937 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-1647a0a4-cf25-4ca6-9338-744f9e76943f tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:32.852160 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1647a0a4-cf25-4ca6-9338-744f9e76943f tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:32.852600 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1647a0a4-cf25-4ca6-9338-744f9e76943f tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:32.853829 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1647a0a4-cf25-4ca6-9338-744f9e76943f tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:32.854420 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1647a0a4-cf25-4ca6-9338-744f9e76943f tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:33.043498 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-1647a0a4-cf25-4ca6-9338-744f9e76943f tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:33.052398 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-1647a0a4-cf25-4ca6-9338-744f9e76943f tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1519 microversion: 2.1 time: 0.210596 Oct 12 04:24:33.053066 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 464/940] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:32 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1519 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:33.917544 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-56b5f359-858d-452f-ab91-ae3222634ed2 req-3d6bc738-37b5-4730-97c4-9b1adf9a3c3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e51919f-b58c-4be5-8869-721e03482c90", "name": "network-vif-unplugged", "status": "completed", "tag": "6126ee1a-6898-4a1c-af64-989fc7fae65a"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:24:33.923191 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:24:33.923191 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:24:33.931075 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-56b5f359-858d-452f-ab91-ae3222634ed2 req-3d6bc738-37b5-4730-97c4-9b1adf9a3c3d service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:33.931727 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-56b5f359-858d-452f-ab91-ae3222634ed2 req-3d6bc738-37b5-4730-97c4-9b1adf9a3c3d service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:33.944060 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.compute.server_external_events [req-56b5f359-858d-452f-ab91-ae3222634ed2 req-3d6bc738-37b5-4730-97c4-9b1adf9a3c3d service nova] Unable to find a host for instance 2e51919f-b58c-4be5-8869-721e03482c90. Dropping event network-vif-unplugged {{(pid=108897) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Oct 12 04:24:33.944931 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-56b5f359-858d-452f-ab91-ae3222634ed2 req-3d6bc738-37b5-4730-97c4-9b1adf9a3c3d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031107 Oct 12 04:24:33.945509 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 477/941] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:24:33 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 12 04:24:34.070938 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-c15781d2-ffd3-41d3-a8b9-b122cca8ab94 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:34.071585 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-c15781d2-ffd3-41d3-a8b9-b122cca8ab94 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:34.077790 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c15781d2-ffd3-41d3-a8b9-b122cca8ab94 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:34.078440 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c15781d2-ffd3-41d3-a8b9-b122cca8ab94 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:34.079436 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c15781d2-ffd3-41d3-a8b9-b122cca8ab94 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:34.080032 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c15781d2-ffd3-41d3-a8b9-b122cca8ab94 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:34.267314 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c15781d2-ffd3-41d3-a8b9-b122cca8ab94 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:34.276903 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-c15781d2-ffd3-41d3-a8b9-b122cca8ab94 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1519 microversion: 2.1 time: 0.209607 Oct 12 04:24:34.277686 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 465/942] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:34 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1519 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:35.317195 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-52ec7712-2c72-49b6-b537-4a74786e742e tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:35.317195 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-52ec7712-2c72-49b6-b537-4a74786e742e tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:35.317195 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-52ec7712-2c72-49b6-b537-4a74786e742e tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:35.317195 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-52ec7712-2c72-49b6-b537-4a74786e742e tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:35.318622 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-52ec7712-2c72-49b6-b537-4a74786e742e tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:35.318622 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-52ec7712-2c72-49b6-b537-4a74786e742e tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:35.442420 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-52ec7712-2c72-49b6-b537-4a74786e742e tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:35.442420 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-52ec7712-2c72-49b6-b537-4a74786e742e tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1575 microversion: 2.1 time: 0.148249 Oct 12 04:24:35.442420 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 478/943] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:35 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:36.457063 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-7aef3dfd-848e-45f1-9f57-19aac8172c35 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:36.457674 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-7aef3dfd-848e-45f1-9f57-19aac8172c35 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:36.463649 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7aef3dfd-848e-45f1-9f57-19aac8172c35 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:36.464186 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7aef3dfd-848e-45f1-9f57-19aac8172c35 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:36.465057 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7aef3dfd-848e-45f1-9f57-19aac8172c35 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:36.465556 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7aef3dfd-848e-45f1-9f57-19aac8172c35 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:36.736321 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-7aef3dfd-848e-45f1-9f57-19aac8172c35 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:36.744745 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-7aef3dfd-848e-45f1-9f57-19aac8172c35 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1575 microversion: 2.1 time: 0.292150 Oct 12 04:24:36.745255 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 466/944] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:36 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1575 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:37.762611 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-b7c265e2-4861-4a64-9096-741ae4f392d9 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:37.764563 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-b7c265e2-4861-4a64-9096-741ae4f392d9 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:37.771320 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b7c265e2-4861-4a64-9096-741ae4f392d9 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:37.771770 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b7c265e2-4861-4a64-9096-741ae4f392d9 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:37.772559 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b7c265e2-4861-4a64-9096-741ae4f392d9 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:37.773028 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b7c265e2-4861-4a64-9096-741ae4f392d9 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:38.137639 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-b7c265e2-4861-4a64-9096-741ae4f392d9 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:38.145911 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-b7c265e2-4861-4a64-9096-741ae4f392d9 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1575 microversion: 2.1 time: 0.387125 Oct 12 04:24:38.146821 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 479/945] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:37 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1575 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:39.162956 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-5005271f-b159-4b67-8fb8-1e99eb55e037 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:39.163562 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-5005271f-b159-4b67-8fb8-1e99eb55e037 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:39.169509 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5005271f-b159-4b67-8fb8-1e99eb55e037 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:39.169947 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5005271f-b159-4b67-8fb8-1e99eb55e037 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:39.170725 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5005271f-b159-4b67-8fb8-1e99eb55e037 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:39.171150 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5005271f-b159-4b67-8fb8-1e99eb55e037 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:39.298488 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-5005271f-b159-4b67-8fb8-1e99eb55e037 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:39.309760 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-5005271f-b159-4b67-8fb8-1e99eb55e037 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1575 microversion: 2.1 time: 0.150404 Oct 12 04:24:39.315113 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 467/946] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:39 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:40.328614 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-149a58ff-28ef-41da-93fa-7dadb9723015 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:40.329355 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-149a58ff-28ef-41da-93fa-7dadb9723015 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:40.335821 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-149a58ff-28ef-41da-93fa-7dadb9723015 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:40.336816 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-149a58ff-28ef-41da-93fa-7dadb9723015 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:40.337337 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-149a58ff-28ef-41da-93fa-7dadb9723015 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:40.337781 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-149a58ff-28ef-41da-93fa-7dadb9723015 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:40.467300 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-149a58ff-28ef-41da-93fa-7dadb9723015 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:40.475190 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-149a58ff-28ef-41da-93fa-7dadb9723015 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1575 microversion: 2.1 time: 0.150609 Oct 12 04:24:40.484148 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 480/947] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:40 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:41.492432 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-91206320-c558-4b2f-80ec-2a1218886b1c tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:41.493040 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-91206320-c558-4b2f-80ec-2a1218886b1c tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:41.498903 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-91206320-c558-4b2f-80ec-2a1218886b1c tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:41.499489 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-91206320-c558-4b2f-80ec-2a1218886b1c tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:41.500249 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-91206320-c558-4b2f-80ec-2a1218886b1c tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:41.500674 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-91206320-c558-4b2f-80ec-2a1218886b1c tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:41.623165 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-91206320-c558-4b2f-80ec-2a1218886b1c tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:41.627758 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-91206320-c558-4b2f-80ec-2a1218886b1c tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1575 microversion: 2.1 time: 0.139111 Oct 12 04:24:41.628321 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 468/948] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:41 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1575 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:42.644812 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-737fb43b-f06f-4a0e-92fb-939d22e79045 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:42.646141 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-737fb43b-f06f-4a0e-92fb-939d22e79045 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:42.652544 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-737fb43b-f06f-4a0e-92fb-939d22e79045 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:42.653723 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-737fb43b-f06f-4a0e-92fb-939d22e79045 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:42.654783 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-737fb43b-f06f-4a0e-92fb-939d22e79045 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:42.655463 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-737fb43b-f06f-4a0e-92fb-939d22e79045 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:42.813989 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-737fb43b-f06f-4a0e-92fb-939d22e79045 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:42.823469 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-737fb43b-f06f-4a0e-92fb-939d22e79045 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1575 microversion: 2.1 time: 0.182913 Oct 12 04:24:42.832965 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 481/949] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:42 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:43.841760 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-f7cd15a8-520f-40dc-8b1c-cb489827cea3 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:43.842310 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-f7cd15a8-520f-40dc-8b1c-cb489827cea3 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:43.856316 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f7cd15a8-520f-40dc-8b1c-cb489827cea3 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:43.856777 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f7cd15a8-520f-40dc-8b1c-cb489827cea3 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:43.857567 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f7cd15a8-520f-40dc-8b1c-cb489827cea3 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:43.858003 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f7cd15a8-520f-40dc-8b1c-cb489827cea3 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:44.111461 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-f7cd15a8-520f-40dc-8b1c-cb489827cea3 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:44.121770 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-f7cd15a8-520f-40dc-8b1c-cb489827cea3 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1575 microversion: 2.1 time: 0.284105 Oct 12 04:24:44.122435 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 469/950] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:43 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1575 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:44.273312 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-4016ef16-4ad5-4548-937a-89ddfa1996a4 req-b5b7699b-c76a-4cbb-8126-2fa1b03a3f60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e51919f-b58c-4be5-8869-721e03482c90", "name": "network-vif-plugged", "status": "completed", "tag": "6126ee1a-6898-4a1c-af64-989fc7fae65a"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:24:44.275712 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:24:44.275712 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:24:44.284454 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-4016ef16-4ad5-4548-937a-89ddfa1996a4 req-b5b7699b-c76a-4cbb-8126-2fa1b03a3f60 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:44.285890 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-4016ef16-4ad5-4548-937a-89ddfa1996a4 req-b5b7699b-c76a-4cbb-8126-2fa1b03a3f60 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:44.302266 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-4016ef16-4ad5-4548-937a-89ddfa1996a4 req-b5b7699b-c76a-4cbb-8126-2fa1b03a3f60 service nova] Creating event network-vif-plugged:6126ee1a-6898-4a1c-af64-989fc7fae65a for instance 2e51919f-b58c-4be5-8869-721e03482c90 on hv-cinder-81306 Oct 12 04:24:44.307721 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-4016ef16-4ad5-4548-937a-89ddfa1996a4 req-b5b7699b-c76a-4cbb-8126-2fa1b03a3f60 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039408 Oct 12 04:24:44.308469 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 482/951] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:24:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:24:45.139869 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-ee63f240-7fad-41e1-8f16-17ecf03b2662 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:45.140896 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-ee63f240-7fad-41e1-8f16-17ecf03b2662 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:45.148376 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ee63f240-7fad-41e1-8f16-17ecf03b2662 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:45.148975 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ee63f240-7fad-41e1-8f16-17ecf03b2662 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:45.149859 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ee63f240-7fad-41e1-8f16-17ecf03b2662 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:45.150292 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ee63f240-7fad-41e1-8f16-17ecf03b2662 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:45.286223 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-ee63f240-7fad-41e1-8f16-17ecf03b2662 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:45.293502 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-ee63f240-7fad-41e1-8f16-17ecf03b2662 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1575 microversion: 2.1 time: 0.158255 Oct 12 04:24:45.294067 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 470/952] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:45 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:46.311641 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-b812cf6a-7dd3-4a81-9256-4c26b9908200 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:46.312237 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-b812cf6a-7dd3-4a81-9256-4c26b9908200 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:46.319369 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b812cf6a-7dd3-4a81-9256-4c26b9908200 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:46.319813 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b812cf6a-7dd3-4a81-9256-4c26b9908200 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:46.320571 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b812cf6a-7dd3-4a81-9256-4c26b9908200 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:46.320996 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b812cf6a-7dd3-4a81-9256-4c26b9908200 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:46.454055 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-b812cf6a-7dd3-4a81-9256-4c26b9908200 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:46.462249 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-b812cf6a-7dd3-4a81-9256-4c26b9908200 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1562 microversion: 2.1 time: 0.154664 Oct 12 04:24:46.462857 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 483/953] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:46 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:52.402413 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-85ad219c-66d2-4364-845e-abd574412121 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Action: 'create', calling method: .version_select at 0x7f3855613310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-694452061"}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:24:52.419260 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-85ad219c-66d2-4364-845e-abd574412121 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Getting quotas for project d393591f50e945b092623c525b160733. Resources: {'key_pairs'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:24:52.422961 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-85ad219c-66d2-4364-845e-abd574412121 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Getting quotas for user 6f580515aad24e708c5dc02b7075328b and project d393591f50e945b092623c525b160733. Resources: {'key_pairs'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:24:52.958652 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-85ad219c-66d2-4364-845e-abd574412121 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Getting quotas for project d393591f50e945b092623c525b160733. Resources: {'key_pairs'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:24:52.962104 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-85ad219c-66d2-4364-845e-abd574412121 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Getting quotas for user 6f580515aad24e708c5dc02b7075328b and project d393591f50e945b092623c525b160733. Resources: {'key_pairs'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:24:52.974459 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-85ad219c-66d2-4364-845e-abd574412121 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.575671 Oct 12 04:24:52.975075 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 471/954] 10.222.0.21 () {60 vars in 1157 bytes} [Tue Oct 12 04:24:52 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:53.022094 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-0c0877ad-7caa-4c59-87ac-a4b83e641f48 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1081122247", "imageRef": "be8351c1-d5d2-45a2-93de-b83939232293", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-694452061", "networks": [{"uuid": "ea0ab6a4-d26b-43b0-a201-5d2b1a8a382f"}]}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:24:53.070307 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.network.neutron [None req-0c0877ad-7caa-4c59-87ac-a4b83e641f48 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] validate_networks() for [('ea0ab6a4-d26b-43b0-a201-5d2b1a8a382f', None, None, None, None, None)] {{(pid=108897) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 04:24:53.511746 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-0c0877ad-7caa-4c59-87ac-a4b83e641f48 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Flavor limits 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 04:24:53.512245 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-0c0877ad-7caa-4c59-87ac-a4b83e641f48 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Image limits 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 04:24:53.512831 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-0c0877ad-7caa-4c59-87ac-a4b83e641f48 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Flavor pref 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 04:24:53.513295 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-0c0877ad-7caa-4c59-87ac-a4b83e641f48 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Image pref 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 04:24:53.513769 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-0c0877ad-7caa-4c59-87ac-a4b83e641f48 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 04:24:53.522895 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0c0877ad-7caa-4c59-87ac-a4b83e641f48 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:53.523340 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0c0877ad-7caa-4c59-87ac-a4b83e641f48 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:53.524143 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0c0877ad-7caa-4c59-87ac-a4b83e641f48 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:53.524581 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0c0877ad-7caa-4c59-87ac-a4b83e641f48 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:53.541674 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-0c0877ad-7caa-4c59-87ac-a4b83e641f48 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Getting quotas for project d393591f50e945b092623c525b160733. Resources: {'cores', 'instances', 'ram'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:24:53.545586 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-0c0877ad-7caa-4c59-87ac-a4b83e641f48 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Getting quotas for user 6f580515aad24e708c5dc02b7075328b and project d393591f50e945b092623c525b160733. Resources: {'cores', 'instances', 'ram'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:24:53.555947 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-0c0877ad-7caa-4c59-87ac-a4b83e641f48 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Going to run 1 instances... {{(pid=108897) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 04:24:53.558117 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-0c0877ad-7caa-4c59-87ac-a4b83e641f48 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='be8351c1-d5d2-45a2-93de-b83939232293',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 04:24:53.679715 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-0c0877ad-7caa-4c59-87ac-a4b83e641f48 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.661136 Oct 12 04:24:53.680368 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 484/955] 10.222.0.21 () {60 vars in 1146 bytes} [Tue Oct 12 04:24:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 04:24:53.690357 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-631f43e6-7fd3-4b0e-b0db-2fbbbb9ac524 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:53.691010 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-631f43e6-7fd3-4b0e-b0db-2fbbbb9ac524 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:53.741830 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-631f43e6-7fd3-4b0e-b0db-2fbbbb9ac524 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:53.748157 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-631f43e6-7fd3-4b0e-b0db-2fbbbb9ac524 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1258 microversion: 2.1 time: 0.061569 Oct 12 04:24:53.748712 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 472/956] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:53 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1258 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:54.765515 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-7c9d87c0-c528-4e41-9bbd-7b4ac8fa0fe5 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:54.766060 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-7c9d87c0-c528-4e41-9bbd-7b4ac8fa0fe5 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:54.772587 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7c9d87c0-c528-4e41-9bbd-7b4ac8fa0fe5 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:54.773041 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7c9d87c0-c528-4e41-9bbd-7b4ac8fa0fe5 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:54.773774 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7c9d87c0-c528-4e41-9bbd-7b4ac8fa0fe5 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:54.774201 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-7c9d87c0-c528-4e41-9bbd-7b4ac8fa0fe5 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:54.836248 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-7c9d87c0-c528-4e41-9bbd-7b4ac8fa0fe5 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:54.844440 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-7c9d87c0-c528-4e41-9bbd-7b4ac8fa0fe5 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1262 microversion: 2.1 time: 0.082409 Oct 12 04:24:54.844998 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 485/957] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:54 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:55.861191 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-0175b0bf-83fe-49df-aefa-b0c31a75661e tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:55.862012 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-0175b0bf-83fe-49df-aefa-b0c31a75661e tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:55.869780 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0175b0bf-83fe-49df-aefa-b0c31a75661e tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:55.873994 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0175b0bf-83fe-49df-aefa-b0c31a75661e tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:55.873994 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0175b0bf-83fe-49df-aefa-b0c31a75661e tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:55.873994 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0175b0bf-83fe-49df-aefa-b0c31a75661e tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:55.933450 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-0175b0bf-83fe-49df-aefa-b0c31a75661e tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:55.940390 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-0175b0bf-83fe-49df-aefa-b0c31a75661e tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1328 microversion: 2.1 time: 0.082840 Oct 12 04:24:55.941559 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 473/958] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:55 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1328 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:56.957679 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-b6735e9d-aad3-4e8e-b225-c7d8d25dae7b tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:56.958388 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-b6735e9d-aad3-4e8e-b225-c7d8d25dae7b tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:56.968564 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b6735e9d-aad3-4e8e-b225-c7d8d25dae7b tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:56.969227 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b6735e9d-aad3-4e8e-b225-c7d8d25dae7b tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:56.970101 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b6735e9d-aad3-4e8e-b225-c7d8d25dae7b tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:56.971538 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b6735e9d-aad3-4e8e-b225-c7d8d25dae7b tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:57.147384 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-b6735e9d-aad3-4e8e-b225-c7d8d25dae7b tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:57.163356 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-b6735e9d-aad3-4e8e-b225-c7d8d25dae7b tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1358 microversion: 2.1 time: 0.209748 Oct 12 04:24:57.173336 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 486/959] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:56 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:57.708871 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-91ac1360-5dc6-4e74-a1ac-cc61d9ab5e73 req-709852de-711f-422e-869f-78f472ed7c29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d64ca24e-5bd0-4420-89d5-beb55714d12a", "tag": "6f4c91da-c3ba-4145-9177-bc95323a2b78"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:24:57.710388 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:24:57.710388 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:24:57.718464 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-91ac1360-5dc6-4e74-a1ac-cc61d9ab5e73 req-709852de-711f-422e-869f-78f472ed7c29 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:57.723079 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-91ac1360-5dc6-4e74-a1ac-cc61d9ab5e73 req-709852de-711f-422e-869f-78f472ed7c29 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:57.736993 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-91ac1360-5dc6-4e74-a1ac-cc61d9ab5e73 req-709852de-711f-422e-869f-78f472ed7c29 service nova] Creating event network-changed:6f4c91da-c3ba-4145-9177-bc95323a2b78 for instance d64ca24e-5bd0-4420-89d5-beb55714d12a on hv-cinder-81306 Oct 12 04:24:57.742928 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-91ac1360-5dc6-4e74-a1ac-cc61d9ab5e73 req-709852de-711f-422e-869f-78f472ed7c29 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037427 Oct 12 04:24:57.743320 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 474/960] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:24:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:24:58.180523 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-1e3bdf69-983a-4c59-ad32-fcbe89df0171 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:58.181148 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-1e3bdf69-983a-4c59-ad32-fcbe89df0171 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:58.187299 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1e3bdf69-983a-4c59-ad32-fcbe89df0171 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:58.187810 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1e3bdf69-983a-4c59-ad32-fcbe89df0171 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:58.188561 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1e3bdf69-983a-4c59-ad32-fcbe89df0171 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:58.189009 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-1e3bdf69-983a-4c59-ad32-fcbe89df0171 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:58.322686 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-1e3bdf69-983a-4c59-ad32-fcbe89df0171 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:58.330185 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-1e3bdf69-983a-4c59-ad32-fcbe89df0171 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1358 microversion: 2.1 time: 0.153504 Oct 12 04:24:58.330765 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 487/961] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:58 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:24:59.348071 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-617b1331-2693-44c4-93da-01550bd7cb3c tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:24:59.348758 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-617b1331-2693-44c4-93da-01550bd7cb3c tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:24:59.355046 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-617b1331-2693-44c4-93da-01550bd7cb3c tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:59.355495 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-617b1331-2693-44c4-93da-01550bd7cb3c tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:59.356251 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-617b1331-2693-44c4-93da-01550bd7cb3c tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:24:59.356682 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-617b1331-2693-44c4-93da-01550bd7cb3c tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:24:59.499701 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-617b1331-2693-44c4-93da-01550bd7cb3c tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:24:59.507459 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-617b1331-2693-44c4-93da-01550bd7cb3c tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1358 microversion: 2.1 time: 0.163550 Oct 12 04:24:59.508013 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 475/962] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:24:59 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:00.524030 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-d0caeb2d-f07f-40d7-bd8d-c4c07568b493 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:00.524717 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-d0caeb2d-f07f-40d7-bd8d-c4c07568b493 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:00.530612 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d0caeb2d-f07f-40d7-bd8d-c4c07568b493 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:00.531042 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d0caeb2d-f07f-40d7-bd8d-c4c07568b493 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:00.531808 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d0caeb2d-f07f-40d7-bd8d-c4c07568b493 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:00.532236 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d0caeb2d-f07f-40d7-bd8d-c4c07568b493 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:00.666949 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-d0caeb2d-f07f-40d7-bd8d-c4c07568b493 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:00.674737 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-d0caeb2d-f07f-40d7-bd8d-c4c07568b493 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1358 microversion: 2.1 time: 0.154282 Oct 12 04:25:00.676303 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 488/963] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:00 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:01.693379 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-03724197-15ee-46f8-990d-5b53ee2c30a0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:01.694765 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-03724197-15ee-46f8-990d-5b53ee2c30a0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:01.700706 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-03724197-15ee-46f8-990d-5b53ee2c30a0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:01.701504 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-03724197-15ee-46f8-990d-5b53ee2c30a0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:01.702915 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-03724197-15ee-46f8-990d-5b53ee2c30a0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:01.703700 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-03724197-15ee-46f8-990d-5b53ee2c30a0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:01.849728 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-03724197-15ee-46f8-990d-5b53ee2c30a0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:01.859596 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-03724197-15ee-46f8-990d-5b53ee2c30a0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1358 microversion: 2.1 time: 0.170629 Oct 12 04:25:01.860179 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 476/964] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:01 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:02.876990 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ba258246-4330-4084-bc27-70baad0388f5 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:02.877594 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ba258246-4330-4084-bc27-70baad0388f5 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:02.884723 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ba258246-4330-4084-bc27-70baad0388f5 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:02.885173 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ba258246-4330-4084-bc27-70baad0388f5 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:02.885992 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ba258246-4330-4084-bc27-70baad0388f5 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:02.886422 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ba258246-4330-4084-bc27-70baad0388f5 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:03.012687 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-ba258246-4330-4084-bc27-70baad0388f5 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:03.020337 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ba258246-4330-4084-bc27-70baad0388f5 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1358 microversion: 2.1 time: 0.147080 Oct 12 04:25:03.020894 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 489/965] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:02 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:04.037141 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-9fbe21fc-4027-43e4-837e-3d996d89bfe2 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:04.037708 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-9fbe21fc-4027-43e4-837e-3d996d89bfe2 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:04.043580 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9fbe21fc-4027-43e4-837e-3d996d89bfe2 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:04.044027 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9fbe21fc-4027-43e4-837e-3d996d89bfe2 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:04.044792 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9fbe21fc-4027-43e4-837e-3d996d89bfe2 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:04.045224 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9fbe21fc-4027-43e4-837e-3d996d89bfe2 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:04.183387 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-9fbe21fc-4027-43e4-837e-3d996d89bfe2 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:04.190470 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-9fbe21fc-4027-43e4-837e-3d996d89bfe2 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1358 microversion: 2.1 time: 0.157693 Oct 12 04:25:04.191119 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 477/966] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:04 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:05.207642 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-997983bf-e586-44d4-8002-22772cfac150 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:05.208331 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-997983bf-e586-44d4-8002-22772cfac150 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:05.214552 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-997983bf-e586-44d4-8002-22772cfac150 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:05.215034 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-997983bf-e586-44d4-8002-22772cfac150 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:05.215827 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-997983bf-e586-44d4-8002-22772cfac150 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:05.216238 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-997983bf-e586-44d4-8002-22772cfac150 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:05.355448 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-997983bf-e586-44d4-8002-22772cfac150 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:05.363513 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-997983bf-e586-44d4-8002-22772cfac150 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1358 microversion: 2.1 time: 0.158959 Oct 12 04:25:05.364090 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 490/967] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:05 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:06.382355 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-e9cdffc0-f2ab-4861-b706-c52f4610d130 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:06.383042 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-e9cdffc0-f2ab-4861-b706-c52f4610d130 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:06.389029 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e9cdffc0-f2ab-4861-b706-c52f4610d130 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:06.389466 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e9cdffc0-f2ab-4861-b706-c52f4610d130 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:06.390219 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e9cdffc0-f2ab-4861-b706-c52f4610d130 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:06.390692 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e9cdffc0-f2ab-4861-b706-c52f4610d130 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:06.541855 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-e9cdffc0-f2ab-4861-b706-c52f4610d130 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:06.551179 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-e9cdffc0-f2ab-4861-b706-c52f4610d130 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1358 microversion: 2.1 time: 0.172859 Oct 12 04:25:06.551973 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 478/968] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:06 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:07.568838 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-8322e147-51df-491f-9d02-285ba2dfa10e tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:07.569453 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-8322e147-51df-491f-9d02-285ba2dfa10e tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:07.575338 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8322e147-51df-491f-9d02-285ba2dfa10e tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:07.575789 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8322e147-51df-491f-9d02-285ba2dfa10e tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:07.576545 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8322e147-51df-491f-9d02-285ba2dfa10e tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:07.576977 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8322e147-51df-491f-9d02-285ba2dfa10e tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:07.702409 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-8322e147-51df-491f-9d02-285ba2dfa10e tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:07.709479 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-8322e147-51df-491f-9d02-285ba2dfa10e tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1358 microversion: 2.1 time: 0.144860 Oct 12 04:25:07.710039 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 491/969] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:07 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:08.726979 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-4823fa9d-2c2f-4d5e-80e3-bc54f68d5ea0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:08.727810 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-4823fa9d-2c2f-4d5e-80e3-bc54f68d5ea0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:08.734273 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4823fa9d-2c2f-4d5e-80e3-bc54f68d5ea0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:08.734895 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4823fa9d-2c2f-4d5e-80e3-bc54f68d5ea0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:08.735751 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4823fa9d-2c2f-4d5e-80e3-bc54f68d5ea0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:08.736408 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4823fa9d-2c2f-4d5e-80e3-bc54f68d5ea0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:08.931334 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-4823fa9d-2c2f-4d5e-80e3-bc54f68d5ea0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:08.938678 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-4823fa9d-2c2f-4d5e-80e3-bc54f68d5ea0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1358 microversion: 2.1 time: 0.216304 Oct 12 04:25:08.943943 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 479/970] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:08 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:09.955795 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-e4ac50a0-de46-4949-8834-853dcd95589f tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:09.956806 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-e4ac50a0-de46-4949-8834-853dcd95589f tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:09.962431 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e4ac50a0-de46-4949-8834-853dcd95589f tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:09.962907 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e4ac50a0-de46-4949-8834-853dcd95589f tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:09.963662 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e4ac50a0-de46-4949-8834-853dcd95589f tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:09.964086 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e4ac50a0-de46-4949-8834-853dcd95589f tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:10.102825 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-e4ac50a0-de46-4949-8834-853dcd95589f tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:10.109907 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-e4ac50a0-de46-4949-8834-853dcd95589f tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1358 microversion: 2.1 time: 0.157665 Oct 12 04:25:10.110541 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 492/971] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:09 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:11.126994 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-933143f3-7f88-4865-b471-d84716d91c70 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:11.127540 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-933143f3-7f88-4865-b471-d84716d91c70 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:11.133256 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-933143f3-7f88-4865-b471-d84716d91c70 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:11.133701 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-933143f3-7f88-4865-b471-d84716d91c70 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:11.134456 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-933143f3-7f88-4865-b471-d84716d91c70 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:11.134921 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-933143f3-7f88-4865-b471-d84716d91c70 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:11.251758 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-933143f3-7f88-4865-b471-d84716d91c70 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:11.258871 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-933143f3-7f88-4865-b471-d84716d91c70 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1358 microversion: 2.1 time: 0.135554 Oct 12 04:25:11.259467 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 480/972] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:11 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1358 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:12.230091 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-9dcd5d74-4ada-41d3-ab40-a7e22eb11abc req-e9f3224f-ca4c-4511-b123-4420a60eb9b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d64ca24e-5bd0-4420-89d5-beb55714d12a", "name": "network-vif-plugged", "status": "completed", "tag": "6f4c91da-c3ba-4145-9177-bc95323a2b78"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:25:12.231679 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:25:12.231679 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:25:12.238793 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-9dcd5d74-4ada-41d3-ab40-a7e22eb11abc req-e9f3224f-ca4c-4511-b123-4420a60eb9b8 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:12.239236 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-9dcd5d74-4ada-41d3-ab40-a7e22eb11abc req-e9f3224f-ca4c-4511-b123-4420a60eb9b8 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:12.249838 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-9dcd5d74-4ada-41d3-ab40-a7e22eb11abc req-e9f3224f-ca4c-4511-b123-4420a60eb9b8 service nova] Creating event network-vif-plugged:6f4c91da-c3ba-4145-9177-bc95323a2b78 for instance d64ca24e-5bd0-4420-89d5-beb55714d12a on hv-cinder-81306 Oct 12 04:25:12.255617 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-9dcd5d74-4ada-41d3-ab40-a7e22eb11abc req-e9f3224f-ca4c-4511-b123-4420a60eb9b8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029453 Oct 12 04:25:12.256214 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 493/973] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:25:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:25:12.278276 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-e85e73a6-5f37-4afb-b52e-0f7319b7d935 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:12.278914 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-e85e73a6-5f37-4afb-b52e-0f7319b7d935 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:12.288910 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e85e73a6-5f37-4afb-b52e-0f7319b7d935 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:12.288910 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e85e73a6-5f37-4afb-b52e-0f7319b7d935 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:12.288910 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e85e73a6-5f37-4afb-b52e-0f7319b7d935 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:12.288910 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e85e73a6-5f37-4afb-b52e-0f7319b7d935 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:12.409798 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-e85e73a6-5f37-4afb-b52e-0f7319b7d935 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:12.416936 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-e85e73a6-5f37-4afb-b52e-0f7319b7d935 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1358 microversion: 2.1 time: 0.142256 Oct 12 04:25:12.419529 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 481/974] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:12 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:25:13.434551 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-873bdce3-e621-42b6-ba9b-9c4bcf30f436 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:13.435274 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-873bdce3-e621-42b6-ba9b-9c4bcf30f436 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:13.441249 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-873bdce3-e621-42b6-ba9b-9c4bcf30f436 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:13.441692 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-873bdce3-e621-42b6-ba9b-9c4bcf30f436 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:13.442448 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-873bdce3-e621-42b6-ba9b-9c4bcf30f436 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:13.442918 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-873bdce3-e621-42b6-ba9b-9c4bcf30f436 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:13.562574 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-873bdce3-e621-42b6-ba9b-9c4bcf30f436 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:13.569838 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-873bdce3-e621-42b6-ba9b-9c4bcf30f436 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1358 microversion: 2.1 time: 0.139199 Oct 12 04:25:13.570406 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 494/975] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:13 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1358 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:14.586332 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-a1bdd191-241f-427c-81b7-12315f1c3586 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:14.586990 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-a1bdd191-241f-427c-81b7-12315f1c3586 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:14.592833 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a1bdd191-241f-427c-81b7-12315f1c3586 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:14.593217 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a1bdd191-241f-427c-81b7-12315f1c3586 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:14.593970 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a1bdd191-241f-427c-81b7-12315f1c3586 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:14.594395 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a1bdd191-241f-427c-81b7-12315f1c3586 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:14.709349 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-a1bdd191-241f-427c-81b7-12315f1c3586 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:14.716549 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-a1bdd191-241f-427c-81b7-12315f1c3586 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1548 microversion: 2.1 time: 0.133853 Oct 12 04:25:14.717106 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 482/976] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:14 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1548 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:14.732472 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-98f9f68d-b7b5-4e93-a4a6-e2e0d505f431 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:14.733090 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-98f9f68d-b7b5-4e93-a4a6-e2e0d505f431 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:14.739452 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-98f9f68d-b7b5-4e93-a4a6-e2e0d505f431 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:14.739899 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-98f9f68d-b7b5-4e93-a4a6-e2e0d505f431 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:14.740662 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-98f9f68d-b7b5-4e93-a4a6-e2e0d505f431 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:14.741099 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-98f9f68d-b7b5-4e93-a4a6-e2e0d505f431 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:14.859766 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-98f9f68d-b7b5-4e93-a4a6-e2e0d505f431 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:14.867503 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-98f9f68d-b7b5-4e93-a4a6-e2e0d505f431 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1548 microversion: 2.1 time: 0.138963 Oct 12 04:25:14.868059 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 495/977] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:14 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1548 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:14.882750 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-052a152a-b8f9-4c91-ab1d-087a0200defd tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:14.886026 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:25:14.886026 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:25:14.887033 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-052a152a-b8f9-4c91-ab1d-087a0200defd tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:14.887767 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-052a152a-b8f9-4c91-ab1d-087a0200defd tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Searching by: {'deleted': False, 'project_id': 'd393591f50e945b092623c525b160733'} {{(pid=108898) get_all /opt/stack/nova/nova/compute/api.py:2905}} Oct 12 04:25:14.894068 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-052a152a-b8f9-4c91-ab1d-087a0200defd tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:14.894504 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-052a152a-b8f9-4c91-ab1d-087a0200defd tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:14.895335 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-052a152a-b8f9-4c91-ab1d-087a0200defd tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:14.895765 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-052a152a-b8f9-4c91-ab1d-087a0200defd tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:14.987634 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.multi_cell_list [None req-052a152a-b8f9-4c91-ab1d-087a0200defd tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=108898) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Oct 12 04:25:15.078836 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-052a152a-b8f9-4c91-ab1d-087a0200defd tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.199643 Oct 12 04:25:15.079417 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 483/978] 10.222.0.21 () {58 vars in 1124 bytes} [Tue Oct 12 04:25:14 2021] GET /compute/v2.1/servers => generated 343 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:25:15.089311 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-b5f6b08a-7e08-4ee3-84a1-1870f52adfbc tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:15.089916 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-b5f6b08a-7e08-4ee3-84a1-1870f52adfbc tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:15.095586 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b5f6b08a-7e08-4ee3-84a1-1870f52adfbc tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:15.096025 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b5f6b08a-7e08-4ee3-84a1-1870f52adfbc tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:15.096810 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b5f6b08a-7e08-4ee3-84a1-1870f52adfbc tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:15.097240 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b5f6b08a-7e08-4ee3-84a1-1870f52adfbc tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:15.215357 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-b5f6b08a-7e08-4ee3-84a1-1870f52adfbc tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:15.222405 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-b5f6b08a-7e08-4ee3-84a1-1870f52adfbc tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1548 microversion: 2.1 time: 0.136671 Oct 12 04:25:15.222980 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 496/979] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:15 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1548 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:17.128149 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-fc339b87-dd41-483c-a152-3b97caec60db tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10338c4f-46c1-4a18-95a3-8b8e76bd4ccf"}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:25:17.130320 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-fc339b87-dd41-483c-a152-3b97caec60db tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:17.136187 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fc339b87-dd41-483c-a152-3b97caec60db tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:17.136626 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fc339b87-dd41-483c-a152-3b97caec60db tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:17.139388 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fc339b87-dd41-483c-a152-3b97caec60db tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:17.140153 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-fc339b87-dd41-483c-a152-3b97caec60db tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:17.855602 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-fc339b87-dd41-483c-a152-3b97caec60db tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "POST /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.732351 Oct 12 04:25:17.856729 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 484/980] 10.222.0.21 () {60 vars in 1322 bytes} [Tue Oct 12 04:25:17 2021] POST /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a/os-volume_attachments => generated 194 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:25:25.363205 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-b7165ab4-71b4-4e6b-a74f-4ac24eb7d6ad tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:25.363818 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-b7165ab4-71b4-4e6b-a74f-4ac24eb7d6ad tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:25.381316 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b7165ab4-71b4-4e6b-a74f-4ac24eb7d6ad tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:25.381316 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b7165ab4-71b4-4e6b-a74f-4ac24eb7d6ad tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:25.381316 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b7165ab4-71b4-4e6b-a74f-4ac24eb7d6ad tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:25.381316 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b7165ab4-71b4-4e6b-a74f-4ac24eb7d6ad tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:25.493866 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-b7165ab4-71b4-4e6b-a74f-4ac24eb7d6ad tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:25.501529 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-b7165ab4-71b4-4e6b-a74f-4ac24eb7d6ad tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1594 microversion: 2.1 time: 0.142317 Oct 12 04:25:25.502085 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 497/981] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:25 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1594 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:27.801258 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-d719af97-909b-48cd-ab8c-5c25bb403f94 req-4c3050f7-b537-47c7-b6d2-36ee60b1f9db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d64ca24e-5bd0-4420-89d5-beb55714d12a", "tag": "6f4c91da-c3ba-4145-9177-bc95323a2b78"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:25:27.803333 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:25:27.803333 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:25:27.811677 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-d719af97-909b-48cd-ab8c-5c25bb403f94 req-4c3050f7-b537-47c7-b6d2-36ee60b1f9db service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:27.812120 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-d719af97-909b-48cd-ab8c-5c25bb403f94 req-4c3050f7-b537-47c7-b6d2-36ee60b1f9db service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:27.822357 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-d719af97-909b-48cd-ab8c-5c25bb403f94 req-4c3050f7-b537-47c7-b6d2-36ee60b1f9db service nova] Creating event network-changed:6f4c91da-c3ba-4145-9177-bc95323a2b78 for instance d64ca24e-5bd0-4420-89d5-beb55714d12a on hv-cinder-81306 Oct 12 04:25:27.827361 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-d719af97-909b-48cd-ab8c-5c25bb403f94 req-4c3050f7-b537-47c7-b6d2-36ee60b1f9db service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030065 Oct 12 04:25:27.827954 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 485/982] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:25:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:25:30.221006 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-fea61a23-345a-493b-9726-219a795a4ed7 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-86159551"}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:25:30.221006 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-fea61a23-345a-493b-9726-219a795a4ed7 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:30.230972 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fea61a23-345a-493b-9726-219a795a4ed7 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:30.231423 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fea61a23-345a-493b-9726-219a795a4ed7 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:30.232191 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fea61a23-345a-493b-9726-219a795a4ed7 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:30.232618 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-fea61a23-345a-493b-9726-219a795a4ed7 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:30.345747 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.network.security_group_api [None req-fea61a23-345a-493b-9726-219a795a4ed7 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Adding security group 4a9ab858-e066-4708-8f2e-376771ac5089 to port 6f4c91da-c3ba-4145-9177-bc95323a2b78 Oct 12 04:25:30.789174 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-fea61a23-345a-493b-9726-219a795a4ed7 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "POST /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a/action" status: 202 len: 0 microversion: 2.1 time: 0.573331 Oct 12 04:25:30.793008 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 498/983] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:25:30 2021] POST /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a/action => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:25:30.799716 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-3ceefd5f-0f9f-4042-980b-d724861d101a tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:30.800510 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-3ceefd5f-0f9f-4042-980b-d724861d101a tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:30.800634 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-eb08235d-a69a-4878-a43a-19db087a64e2 req-6c94557c-20bd-4a8e-95eb-51539dc9f3a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d64ca24e-5bd0-4420-89d5-beb55714d12a", "tag": "6f4c91da-c3ba-4145-9177-bc95323a2b78"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:25:30.804133 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:25:30.804133 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:25:30.809346 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3ceefd5f-0f9f-4042-980b-d724861d101a tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:30.810018 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3ceefd5f-0f9f-4042-980b-d724861d101a tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:30.810860 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3ceefd5f-0f9f-4042-980b-d724861d101a tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:30.811747 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3ceefd5f-0f9f-4042-980b-d724861d101a tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:30.820752 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-eb08235d-a69a-4878-a43a-19db087a64e2 req-6c94557c-20bd-4a8e-95eb-51539dc9f3a1 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:30.822979 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-eb08235d-a69a-4878-a43a-19db087a64e2 req-6c94557c-20bd-4a8e-95eb-51539dc9f3a1 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:30.852381 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-eb08235d-a69a-4878-a43a-19db087a64e2 req-6c94557c-20bd-4a8e-95eb-51539dc9f3a1 service nova] Creating event network-changed:6f4c91da-c3ba-4145-9177-bc95323a2b78 for instance d64ca24e-5bd0-4420-89d5-beb55714d12a on hv-cinder-81306 Oct 12 04:25:30.860040 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-eb08235d-a69a-4878-a43a-19db087a64e2 req-6c94557c-20bd-4a8e-95eb-51539dc9f3a1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063955 Oct 12 04:25:30.860926 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 499/984] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:25:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:25:31.073581 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-3ceefd5f-0f9f-4042-980b-d724861d101a tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:31.081881 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-3ceefd5f-0f9f-4042-980b-d724861d101a tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1756 microversion: 2.1 time: 0.287385 Oct 12 04:25:31.085832 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 486/985] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:30 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1756 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:34.510552 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ce4755cc-a8ef-4b78-b812-facc4c9e0e30 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1474345856", "imageRef": "bf8c5573-3890-45dc-aec8-b1ad89136f80", "flavorRef": "452", "networks": [{"uuid": "cc0ecb2c-871a-4433-93b4-525087c5ea67"}]}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:25:34.559368 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.network.neutron [None req-ce4755cc-a8ef-4b78-b812-facc4c9e0e30 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] validate_networks() for [('cc0ecb2c-871a-4433-93b4-525087c5ea67', None, None, None, None, None)] {{(pid=108897) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 04:25:34.898107 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-ce4755cc-a8ef-4b78-b812-facc4c9e0e30 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Flavor limits 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 04:25:34.898527 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-ce4755cc-a8ef-4b78-b812-facc4c9e0e30 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Image limits 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 04:25:34.899035 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-ce4755cc-a8ef-4b78-b812-facc4c9e0e30 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Flavor pref 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 04:25:34.899444 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-ce4755cc-a8ef-4b78-b812-facc4c9e0e30 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Image pref 0:0:0 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 04:25:34.899856 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.virt.hardware [None req-ce4755cc-a8ef-4b78-b812-facc4c9e0e30 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 04:25:34.908792 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ce4755cc-a8ef-4b78-b812-facc4c9e0e30 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:34.909233 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ce4755cc-a8ef-4b78-b812-facc4c9e0e30 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:34.910030 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ce4755cc-a8ef-4b78-b812-facc4c9e0e30 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:34.910458 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ce4755cc-a8ef-4b78-b812-facc4c9e0e30 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:34.926004 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-ce4755cc-a8ef-4b78-b812-facc4c9e0e30 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Getting quotas for project 350b2ff78dac4a14a12b78bb343d4195. Resources: {'cores', 'instances', 'ram'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:25:34.930368 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-ce4755cc-a8ef-4b78-b812-facc4c9e0e30 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Getting quotas for user d61f561e270a4b658506d0a22f562dc8 and project 350b2ff78dac4a14a12b78bb343d4195. Resources: {'cores', 'instances', 'ram'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:25:34.940571 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ce4755cc-a8ef-4b78-b812-facc4c9e0e30 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Going to run 1 instances... {{(pid=108897) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 04:25:34.942922 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ce4755cc-a8ef-4b78-b812-facc4c9e0e30 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: 6ead9e5d-68f2-43dc-9d09-e224a01a05b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf8c5573-3890-45dc-aec8-b1ad89136f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 04:25:35.089830 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ce4755cc-a8ef-4b78-b812-facc4c9e0e30 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583899 Oct 12 04:25:35.090451 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 500/986] 10.222.0.21 () {60 vars in 1146 bytes} [Tue Oct 12 04:25:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 04:25:35.100783 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d4a90a12-424e-4621-abec-6a99e873a302 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:35.101378 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-d4a90a12-424e-4621-abec-6a99e873a302 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: 6ead9e5d-68f2-43dc-9d09-e224a01a05b4] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:35.161027 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-d4a90a12-424e-4621-abec-6a99e873a302 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:35.167872 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-d4a90a12-424e-4621-abec-6a99e873a302 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4" status: 200 len: 1219 microversion: 2.1 time: 0.071296 Oct 12 04:25:35.168429 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 487/987] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:35 2021] GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:36.184563 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-c61bd7b7-0b29-47fe-b015-07f9ba8f6afa tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:36.185192 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-c61bd7b7-0b29-47fe-b015-07f9ba8f6afa tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: 6ead9e5d-68f2-43dc-9d09-e224a01a05b4] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:36.191311 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c61bd7b7-0b29-47fe-b015-07f9ba8f6afa tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:36.191752 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c61bd7b7-0b29-47fe-b015-07f9ba8f6afa tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:36.192507 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c61bd7b7-0b29-47fe-b015-07f9ba8f6afa tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:36.192935 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c61bd7b7-0b29-47fe-b015-07f9ba8f6afa tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:36.251863 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-c61bd7b7-0b29-47fe-b015-07f9ba8f6afa tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:36.259505 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-c61bd7b7-0b29-47fe-b015-07f9ba8f6afa tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4" status: 200 len: 1223 microversion: 2.1 time: 0.078674 Oct 12 04:25:36.260050 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 501/988] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:36 2021] GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:37.275986 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-2d2dc9eb-d9fa-4083-94ec-49fce92285d3 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:37.276627 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-2d2dc9eb-d9fa-4083-94ec-49fce92285d3 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: 6ead9e5d-68f2-43dc-9d09-e224a01a05b4] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:37.283174 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2d2dc9eb-d9fa-4083-94ec-49fce92285d3 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:37.283617 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2d2dc9eb-d9fa-4083-94ec-49fce92285d3 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:37.284379 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2d2dc9eb-d9fa-4083-94ec-49fce92285d3 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:37.284814 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2d2dc9eb-d9fa-4083-94ec-49fce92285d3 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:37.385156 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-2d2dc9eb-d9fa-4083-94ec-49fce92285d3 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:37.392376 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-2d2dc9eb-d9fa-4083-94ec-49fce92285d3 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4" status: 200 len: 1279 microversion: 2.1 time: 0.120572 Oct 12 04:25:37.436319 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 488/989] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:37 2021] GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4 => generated 1279 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:38.423822 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-c2d9e231-4a93-41b3-9515-5e9e1aa8383e tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:38.424418 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-c2d9e231-4a93-41b3-9515-5e9e1aa8383e tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: 6ead9e5d-68f2-43dc-9d09-e224a01a05b4] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:38.430130 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c2d9e231-4a93-41b3-9515-5e9e1aa8383e tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:38.430574 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c2d9e231-4a93-41b3-9515-5e9e1aa8383e tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:38.431366 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c2d9e231-4a93-41b3-9515-5e9e1aa8383e tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:38.431800 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-c2d9e231-4a93-41b3-9515-5e9e1aa8383e tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:38.636873 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-c2d9e231-4a93-41b3-9515-5e9e1aa8383e tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:38.644189 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-c2d9e231-4a93-41b3-9515-5e9e1aa8383e tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4" status: 200 len: 1319 microversion: 2.1 time: 0.224022 Oct 12 04:25:38.644738 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 502/990] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:38 2021] GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:39.088107 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-220d3654-b368-4223-be56-23b069a03909 req-2ba67c73-276b-47c9-8191-c7ec10678bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ead9e5d-68f2-43dc-9d09-e224a01a05b4", "tag": "a3222ba8-4a30-41a2-853f-668d4c53a0fe"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:25:39.089646 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:25:39.089646 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:25:39.096244 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-220d3654-b368-4223-be56-23b069a03909 req-2ba67c73-276b-47c9-8191-c7ec10678bd0 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:39.098807 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-220d3654-b368-4223-be56-23b069a03909 req-2ba67c73-276b-47c9-8191-c7ec10678bd0 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:39.107429 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-220d3654-b368-4223-be56-23b069a03909 req-2ba67c73-276b-47c9-8191-c7ec10678bd0 service nova] Creating event network-changed:a3222ba8-4a30-41a2-853f-668d4c53a0fe for instance 6ead9e5d-68f2-43dc-9d09-e224a01a05b4 on hv-cinder-81306 Oct 12 04:25:39.112173 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-220d3654-b368-4223-be56-23b069a03909 req-2ba67c73-276b-47c9-8191-c7ec10678bd0 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027673 Oct 12 04:25:39.112827 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 489/991] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:25:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:25:39.661213 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-f266231b-940b-4d86-8fe3-34ed42484d64 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:39.661770 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-f266231b-940b-4d86-8fe3-34ed42484d64 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: 6ead9e5d-68f2-43dc-9d09-e224a01a05b4] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:39.667899 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f266231b-940b-4d86-8fe3-34ed42484d64 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:39.668346 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f266231b-940b-4d86-8fe3-34ed42484d64 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:39.669114 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f266231b-940b-4d86-8fe3-34ed42484d64 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:39.669547 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f266231b-940b-4d86-8fe3-34ed42484d64 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:39.837387 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-f266231b-940b-4d86-8fe3-34ed42484d64 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:39.844414 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-f266231b-940b-4d86-8fe3-34ed42484d64 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4" status: 200 len: 1319 microversion: 2.1 time: 0.186954 Oct 12 04:25:39.844971 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 503/992] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:39 2021] GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:40.861579 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-173d4d4e-7740-4f2c-be09-7b5dbac50fd6 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:40.862266 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-173d4d4e-7740-4f2c-be09-7b5dbac50fd6 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: 6ead9e5d-68f2-43dc-9d09-e224a01a05b4] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:40.868734 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-173d4d4e-7740-4f2c-be09-7b5dbac50fd6 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:40.869175 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-173d4d4e-7740-4f2c-be09-7b5dbac50fd6 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:40.869926 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-173d4d4e-7740-4f2c-be09-7b5dbac50fd6 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:40.870352 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-173d4d4e-7740-4f2c-be09-7b5dbac50fd6 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:40.991865 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-173d4d4e-7740-4f2c-be09-7b5dbac50fd6 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:40.998866 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-173d4d4e-7740-4f2c-be09-7b5dbac50fd6 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4" status: 200 len: 1319 microversion: 2.1 time: 0.141227 Oct 12 04:25:40.999424 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 490/993] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:40 2021] GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4 => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:42.015629 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-bcfbf205-ecea-43d0-a825-3f0a897e405a tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:42.016201 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-bcfbf205-ecea-43d0-a825-3f0a897e405a tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: 6ead9e5d-68f2-43dc-9d09-e224a01a05b4] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:42.021883 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bcfbf205-ecea-43d0-a825-3f0a897e405a tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:42.022322 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bcfbf205-ecea-43d0-a825-3f0a897e405a tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:42.023669 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bcfbf205-ecea-43d0-a825-3f0a897e405a tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:42.024095 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-bcfbf205-ecea-43d0-a825-3f0a897e405a tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:42.144551 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-bcfbf205-ecea-43d0-a825-3f0a897e405a tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:42.151751 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-bcfbf205-ecea-43d0-a825-3f0a897e405a tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4" status: 200 len: 1319 microversion: 2.1 time: 0.139835 Oct 12 04:25:42.152306 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 504/994] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:42 2021] GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4 => generated 1319 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:25:43.168165 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-0079058f-410f-4e22-b244-4c7d1c2b516b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:43.168757 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-0079058f-410f-4e22-b244-4c7d1c2b516b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: 6ead9e5d-68f2-43dc-9d09-e224a01a05b4] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:43.174943 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0079058f-410f-4e22-b244-4c7d1c2b516b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:43.175387 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0079058f-410f-4e22-b244-4c7d1c2b516b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:43.176147 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0079058f-410f-4e22-b244-4c7d1c2b516b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:43.176577 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0079058f-410f-4e22-b244-4c7d1c2b516b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:43.292744 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-0079058f-410f-4e22-b244-4c7d1c2b516b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:43.299843 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-0079058f-410f-4e22-b244-4c7d1c2b516b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4" status: 200 len: 1319 microversion: 2.1 time: 0.135268 Oct 12 04:25:43.300391 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 491/995] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:43 2021] GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4 => generated 1319 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:44.315648 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-5ead0670-aa3a-4686-a93d-34d23c7cac6b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:44.316261 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-5ead0670-aa3a-4686-a93d-34d23c7cac6b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: 6ead9e5d-68f2-43dc-9d09-e224a01a05b4] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:44.322064 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5ead0670-aa3a-4686-a93d-34d23c7cac6b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:44.327765 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5ead0670-aa3a-4686-a93d-34d23c7cac6b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:44.327765 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5ead0670-aa3a-4686-a93d-34d23c7cac6b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:44.327765 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5ead0670-aa3a-4686-a93d-34d23c7cac6b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:44.444548 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-5ead0670-aa3a-4686-a93d-34d23c7cac6b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:44.451872 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-5ead0670-aa3a-4686-a93d-34d23c7cac6b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4" status: 200 len: 1319 microversion: 2.1 time: 0.139908 Oct 12 04:25:44.452428 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 505/996] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:44 2021] GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4 => generated 1319 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:45.468950 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-000eb812-fc69-4b13-a1cb-c52dd29bb18d tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:45.469480 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-000eb812-fc69-4b13-a1cb-c52dd29bb18d tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: 6ead9e5d-68f2-43dc-9d09-e224a01a05b4] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:45.476154 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-000eb812-fc69-4b13-a1cb-c52dd29bb18d tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:45.476625 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-000eb812-fc69-4b13-a1cb-c52dd29bb18d tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:45.477371 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-000eb812-fc69-4b13-a1cb-c52dd29bb18d tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:45.477793 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-000eb812-fc69-4b13-a1cb-c52dd29bb18d tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:45.592539 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-000eb812-fc69-4b13-a1cb-c52dd29bb18d tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:45.599508 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-000eb812-fc69-4b13-a1cb-c52dd29bb18d tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4" status: 200 len: 1319 microversion: 2.1 time: 0.134242 Oct 12 04:25:45.600061 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 492/997] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:45 2021] GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4 => generated 1319 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:46.318125 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-425ffa43-6b90-4d55-8f20-74c02401715b req-0f81797b-bb12-49c9-9435-5d198288e637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ead9e5d-68f2-43dc-9d09-e224a01a05b4", "name": "network-vif-plugged", "status": "completed", "tag": "a3222ba8-4a30-41a2-853f-668d4c53a0fe"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:25:46.320222 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:25:46.320222 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:25:46.326939 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-425ffa43-6b90-4d55-8f20-74c02401715b req-0f81797b-bb12-49c9-9435-5d198288e637 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:46.333747 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-425ffa43-6b90-4d55-8f20-74c02401715b req-0f81797b-bb12-49c9-9435-5d198288e637 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:46.338455 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-425ffa43-6b90-4d55-8f20-74c02401715b req-0f81797b-bb12-49c9-9435-5d198288e637 service nova] Creating event network-vif-plugged:a3222ba8-4a30-41a2-853f-668d4c53a0fe for instance 6ead9e5d-68f2-43dc-9d09-e224a01a05b4 on hv-cinder-81306 Oct 12 04:25:46.343560 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-425ffa43-6b90-4d55-8f20-74c02401715b req-0f81797b-bb12-49c9-9435-5d198288e637 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028991 Oct 12 04:25:46.344354 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 506/998] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:25:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:25:46.617332 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-202661d7-5680-492e-9211-6832a0c40d46 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:46.617938 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-202661d7-5680-492e-9211-6832a0c40d46 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: 6ead9e5d-68f2-43dc-9d09-e224a01a05b4] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:46.623502 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-202661d7-5680-492e-9211-6832a0c40d46 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:46.623947 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-202661d7-5680-492e-9211-6832a0c40d46 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:46.624717 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-202661d7-5680-492e-9211-6832a0c40d46 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:46.625144 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-202661d7-5680-492e-9211-6832a0c40d46 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:46.744161 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-202661d7-5680-492e-9211-6832a0c40d46 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:46.751163 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-202661d7-5680-492e-9211-6832a0c40d46 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4" status: 200 len: 1319 microversion: 2.1 time: 0.138019 Oct 12 04:25:46.751907 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 493/999] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:46 2021] GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4 => generated 1319 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:47.769012 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-3ac96a9b-b85a-4608-a4a3-a9dd5f646a4a tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:47.771717 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-3ac96a9b-b85a-4608-a4a3-a9dd5f646a4a tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: 6ead9e5d-68f2-43dc-9d09-e224a01a05b4] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:47.776504 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3ac96a9b-b85a-4608-a4a3-a9dd5f646a4a tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:47.776948 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3ac96a9b-b85a-4608-a4a3-a9dd5f646a4a tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:47.778016 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3ac96a9b-b85a-4608-a4a3-a9dd5f646a4a tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:47.778443 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-3ac96a9b-b85a-4608-a4a3-a9dd5f646a4a tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:47.912212 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-3ac96a9b-b85a-4608-a4a3-a9dd5f646a4a tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:47.919341 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-3ac96a9b-b85a-4608-a4a3-a9dd5f646a4a tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4" status: 200 len: 1319 microversion: 2.1 time: 0.154464 Oct 12 04:25:47.919890 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 507/1000] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:47 2021] GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:48.935802 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-cd2b7a9e-c68d-43ed-bffc-f56bca18058b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:48.936409 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-cd2b7a9e-c68d-43ed-bffc-f56bca18058b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: 6ead9e5d-68f2-43dc-9d09-e224a01a05b4] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:48.942160 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-cd2b7a9e-c68d-43ed-bffc-f56bca18058b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:48.942602 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-cd2b7a9e-c68d-43ed-bffc-f56bca18058b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:48.943395 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-cd2b7a9e-c68d-43ed-bffc-f56bca18058b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:48.943818 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-cd2b7a9e-c68d-43ed-bffc-f56bca18058b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:49.060682 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-cd2b7a9e-c68d-43ed-bffc-f56bca18058b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:49.067978 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-cd2b7a9e-c68d-43ed-bffc-f56bca18058b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4" status: 200 len: 1508 microversion: 2.1 time: 0.135819 Oct 12 04:25:49.068578 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 494/1001] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:48 2021] GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4 => generated 1508 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:25:53.644412 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-d4e9f9fd-1795-4c09-8026-1cda12cc6213 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:25:53.645347 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-d4e9f9fd-1795-4c09-8026-1cda12cc6213 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:53.651729 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d4e9f9fd-1795-4c09-8026-1cda12cc6213 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:53.652176 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d4e9f9fd-1795-4c09-8026-1cda12cc6213 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:53.652932 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d4e9f9fd-1795-4c09-8026-1cda12cc6213 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:53.653363 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d4e9f9fd-1795-4c09-8026-1cda12cc6213 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:53.869708 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-d4e9f9fd-1795-4c09-8026-1cda12cc6213 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "POST /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a/action" status: 202 len: 0 microversion: 2.1 time: 0.228734 Oct 12 04:25:53.870384 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 508/1002] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:25:53 2021] POST /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:25:53.878979 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-f1fc3a05-6c96-4931-b4a4-4248e560906e tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:53.879606 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-f1fc3a05-6c96-4931-b4a4-4248e560906e tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:53.886060 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f1fc3a05-6c96-4931-b4a4-4248e560906e tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:53.886495 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f1fc3a05-6c96-4931-b4a4-4248e560906e tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:53.887280 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f1fc3a05-6c96-4931-b4a4-4248e560906e tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:53.887707 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f1fc3a05-6c96-4931-b4a4-4248e560906e tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:54.042133 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-f1fc3a05-6c96-4931-b4a4-4248e560906e tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:54.049926 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-f1fc3a05-6c96-4931-b4a4-4248e560906e tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1748 microversion: 2.1 time: 0.175289 Oct 12 04:25:54.050522 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 495/1003] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:53 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1748 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:55.068082 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-2d24f0a5-3cf0-4306-b367-38ae71162727 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:55.068776 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-2d24f0a5-3cf0-4306-b367-38ae71162727 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:55.074855 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2d24f0a5-3cf0-4306-b367-38ae71162727 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:55.075308 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2d24f0a5-3cf0-4306-b367-38ae71162727 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:55.076061 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2d24f0a5-3cf0-4306-b367-38ae71162727 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:55.076495 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2d24f0a5-3cf0-4306-b367-38ae71162727 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:55.466814 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-2d24f0a5-3cf0-4306-b367-38ae71162727 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:55.475707 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-2d24f0a5-3cf0-4306-b367-38ae71162727 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1753 microversion: 2.1 time: 0.411685 Oct 12 04:25:55.476267 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 509/1004] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:55 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1753 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:56.493631 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-1e270740-bebc-4752-96c7-9706a691dfc1 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:56.494199 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-1e270740-bebc-4752-96c7-9706a691dfc1 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:56.499943 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1e270740-bebc-4752-96c7-9706a691dfc1 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:56.500377 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1e270740-bebc-4752-96c7-9706a691dfc1 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:56.501124 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1e270740-bebc-4752-96c7-9706a691dfc1 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:56.501551 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1e270740-bebc-4752-96c7-9706a691dfc1 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:56.622527 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-1e270740-bebc-4752-96c7-9706a691dfc1 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:56.630242 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-1e270740-bebc-4752-96c7-9706a691dfc1 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1753 microversion: 2.1 time: 0.140492 Oct 12 04:25:56.630817 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 496/1005] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:56 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1753 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:57.646846 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ff900b05-75d9-4263-a7ad-118eebb71e5b tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:57.647455 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ff900b05-75d9-4263-a7ad-118eebb71e5b tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:57.653412 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ff900b05-75d9-4263-a7ad-118eebb71e5b tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:57.653898 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ff900b05-75d9-4263-a7ad-118eebb71e5b tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:57.654650 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ff900b05-75d9-4263-a7ad-118eebb71e5b tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:57.655116 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ff900b05-75d9-4263-a7ad-118eebb71e5b tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:57.780891 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-ff900b05-75d9-4263-a7ad-118eebb71e5b tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:57.788466 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ff900b05-75d9-4263-a7ad-118eebb71e5b tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1753 microversion: 2.1 time: 0.145239 Oct 12 04:25:57.789647 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 510/1006] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:57 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1753 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:58.806293 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-277cc9d3-250c-4b5b-b8e9-f169f1953ade tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:58.806918 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-277cc9d3-250c-4b5b-b8e9-f169f1953ade tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:58.812685 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-277cc9d3-250c-4b5b-b8e9-f169f1953ade tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:58.813124 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-277cc9d3-250c-4b5b-b8e9-f169f1953ade tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:58.813876 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-277cc9d3-250c-4b5b-b8e9-f169f1953ade tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:58.814298 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-277cc9d3-250c-4b5b-b8e9-f169f1953ade tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:58.934533 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-277cc9d3-250c-4b5b-b8e9-f169f1953ade tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:25:58.942187 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-277cc9d3-250c-4b5b-b8e9-f169f1953ade tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1753 microversion: 2.1 time: 0.140023 Oct 12 04:25:58.942750 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 497/1007] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:58 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1753 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:25:59.958819 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-48ee2bb2-0ceb-4774-87ee-d8573f468110 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:25:59.959426 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-48ee2bb2-0ceb-4774-87ee-d8573f468110 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:25:59.965391 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-48ee2bb2-0ceb-4774-87ee-d8573f468110 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:59.965833 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-48ee2bb2-0ceb-4774-87ee-d8573f468110 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:25:59.966577 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-48ee2bb2-0ceb-4774-87ee-d8573f468110 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:25:59.967058 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-48ee2bb2-0ceb-4774-87ee-d8573f468110 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:00.087236 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-48ee2bb2-0ceb-4774-87ee-d8573f468110 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:00.094857 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-48ee2bb2-0ceb-4774-87ee-d8573f468110 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1753 microversion: 2.1 time: 0.139611 Oct 12 04:26:00.095410 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 511/1008] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:25:59 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1753 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:01.111574 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-a6ba0c1e-776b-4f27-8f64-770e575696b3 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:01.112175 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-a6ba0c1e-776b-4f27-8f64-770e575696b3 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:01.118680 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a6ba0c1e-776b-4f27-8f64-770e575696b3 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:01.119126 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a6ba0c1e-776b-4f27-8f64-770e575696b3 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:01.119906 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a6ba0c1e-776b-4f27-8f64-770e575696b3 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:01.120330 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-a6ba0c1e-776b-4f27-8f64-770e575696b3 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:01.245581 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-a6ba0c1e-776b-4f27-8f64-770e575696b3 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:01.253124 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-a6ba0c1e-776b-4f27-8f64-770e575696b3 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1753 microversion: 2.1 time: 0.145137 Oct 12 04:26:01.253658 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 498/1009] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:01 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1753 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:02.269092 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-975f9259-4903-4b2b-b540-16c6212e6ee7 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:02.269687 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-975f9259-4903-4b2b-b540-16c6212e6ee7 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:02.276225 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-975f9259-4903-4b2b-b540-16c6212e6ee7 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:02.276677 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-975f9259-4903-4b2b-b540-16c6212e6ee7 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:02.277469 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-975f9259-4903-4b2b-b540-16c6212e6ee7 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:02.277900 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-975f9259-4903-4b2b-b540-16c6212e6ee7 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:02.397237 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-975f9259-4903-4b2b-b540-16c6212e6ee7 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:02.404841 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-975f9259-4903-4b2b-b540-16c6212e6ee7 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1753 microversion: 2.1 time: 0.139518 Oct 12 04:26:02.405396 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 512/1010] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:02 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1753 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:03.421461 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-83ef4fca-3b9d-404e-8ec0-87554840fa7c tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:03.421988 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-83ef4fca-3b9d-404e-8ec0-87554840fa7c tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:03.427636 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-83ef4fca-3b9d-404e-8ec0-87554840fa7c tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:03.428072 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-83ef4fca-3b9d-404e-8ec0-87554840fa7c tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:03.428820 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-83ef4fca-3b9d-404e-8ec0-87554840fa7c tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:03.429242 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-83ef4fca-3b9d-404e-8ec0-87554840fa7c tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:03.557079 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-83ef4fca-3b9d-404e-8ec0-87554840fa7c tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:03.564661 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-83ef4fca-3b9d-404e-8ec0-87554840fa7c tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1753 microversion: 2.1 time: 0.146873 Oct 12 04:26:03.565218 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 499/1011] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:03 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1753 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:04.581905 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-15918f83-7951-456a-b89b-232d220ead43 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:04.582486 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-15918f83-7951-456a-b89b-232d220ead43 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:04.588844 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-15918f83-7951-456a-b89b-232d220ead43 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:04.589285 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-15918f83-7951-456a-b89b-232d220ead43 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:04.590032 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-15918f83-7951-456a-b89b-232d220ead43 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:04.590466 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-15918f83-7951-456a-b89b-232d220ead43 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:04.711900 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-15918f83-7951-456a-b89b-232d220ead43 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:04.719443 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-15918f83-7951-456a-b89b-232d220ead43 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1753 microversion: 2.1 time: 0.141156 Oct 12 04:26:04.720005 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 513/1012] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:04 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1753 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:05.737179 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-5eb3b99e-67ee-462d-840d-f15faba42e80 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:05.737738 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-5eb3b99e-67ee-462d-840d-f15faba42e80 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:05.744274 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5eb3b99e-67ee-462d-840d-f15faba42e80 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:05.744719 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5eb3b99e-67ee-462d-840d-f15faba42e80 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:05.745480 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5eb3b99e-67ee-462d-840d-f15faba42e80 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:05.745917 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5eb3b99e-67ee-462d-840d-f15faba42e80 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:05.867626 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-5eb3b99e-67ee-462d-840d-f15faba42e80 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:05.875397 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-5eb3b99e-67ee-462d-840d-f15faba42e80 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1753 microversion: 2.1 time: 0.141979 Oct 12 04:26:05.875982 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 500/1013] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:05 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1753 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:06.485345 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-cc907276-3d81-4aef-990e-1d59c100eedb tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a79c136-686d-4d19-81cd-e3a260592b78", "device": "/dev/sdb"}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:26:06.486915 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-cc907276-3d81-4aef-990e-1d59c100eedb tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: 6ead9e5d-68f2-43dc-9d09-e224a01a05b4] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:06.492579 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-cc907276-3d81-4aef-990e-1d59c100eedb tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:06.493027 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-cc907276-3d81-4aef-990e-1d59c100eedb tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:06.493922 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-cc907276-3d81-4aef-990e-1d59c100eedb tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:06.494360 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-cc907276-3d81-4aef-990e-1d59c100eedb tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:06.891297 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-60a1b65f-0006-4173-b507-59ad753db773 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:06.892891 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-60a1b65f-0006-4173-b507-59ad753db773 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:06.897796 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-60a1b65f-0006-4173-b507-59ad753db773 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:06.898236 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-60a1b65f-0006-4173-b507-59ad753db773 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:06.899028 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-60a1b65f-0006-4173-b507-59ad753db773 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:06.899465 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-60a1b65f-0006-4173-b507-59ad753db773 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:07.053323 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-60a1b65f-0006-4173-b507-59ad753db773 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:07.061390 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-60a1b65f-0006-4173-b507-59ad753db773 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1753 microversion: 2.1 time: 0.173770 Oct 12 04:26:07.061946 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 501/1014] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:06 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1753 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:26:07.148964 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-cc907276-3d81-4aef-990e-1d59c100eedb tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "POST /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.667177 Oct 12 04:26:07.149548 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 514/1015] 10.222.0.21 () {60 vars in 1322 bytes} [Tue Oct 12 04:26:06 2021] POST /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4/os-volume_attachments => generated 194 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:26:08.078708 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-7a1e067a-1f1c-427c-aa84-571c45c8f8bd tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:08.079320 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-7a1e067a-1f1c-427c-aa84-571c45c8f8bd tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:08.085171 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7a1e067a-1f1c-427c-aa84-571c45c8f8bd tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:08.086276 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7a1e067a-1f1c-427c-aa84-571c45c8f8bd tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:08.087067 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7a1e067a-1f1c-427c-aa84-571c45c8f8bd tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:08.087502 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7a1e067a-1f1c-427c-aa84-571c45c8f8bd tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:08.205509 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-7a1e067a-1f1c-427c-aa84-571c45c8f8bd tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:08.214778 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-7a1e067a-1f1c-427c-aa84-571c45c8f8bd tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1753 microversion: 2.1 time: 0.139571 Oct 12 04:26:08.218063 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 502/1016] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:08 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1753 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:09.233548 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-70b586d6-e7aa-4ffa-bf09-c5d4199c7bbd tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:09.234247 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-70b586d6-e7aa-4ffa-bf09-c5d4199c7bbd tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:09.240270 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-70b586d6-e7aa-4ffa-bf09-c5d4199c7bbd tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:09.240719 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-70b586d6-e7aa-4ffa-bf09-c5d4199c7bbd tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:09.241480 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-70b586d6-e7aa-4ffa-bf09-c5d4199c7bbd tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:09.241916 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-70b586d6-e7aa-4ffa-bf09-c5d4199c7bbd tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:09.363185 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-70b586d6-e7aa-4ffa-bf09-c5d4199c7bbd tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:09.370827 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-70b586d6-e7aa-4ffa-bf09-c5d4199c7bbd tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1753 microversion: 2.1 time: 0.142041 Oct 12 04:26:09.371406 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 515/1017] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:09 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1753 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:10.388099 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-96683113-8f0d-413c-ba8f-19a932bd0141 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:10.388742 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-96683113-8f0d-413c-ba8f-19a932bd0141 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:10.394455 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-96683113-8f0d-413c-ba8f-19a932bd0141 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:10.394925 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-96683113-8f0d-413c-ba8f-19a932bd0141 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:10.395675 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-96683113-8f0d-413c-ba8f-19a932bd0141 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:10.396098 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-96683113-8f0d-413c-ba8f-19a932bd0141 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:10.520159 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-96683113-8f0d-413c-ba8f-19a932bd0141 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:10.528461 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-96683113-8f0d-413c-ba8f-19a932bd0141 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1753 microversion: 2.1 time: 0.144065 Oct 12 04:26:10.531226 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 503/1018] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:10 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1753 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:11.546143 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-4cc6ca54-aa3a-4fdb-bfbc-350cd0e337b0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:11.546772 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-4cc6ca54-aa3a-4fdb-bfbc-350cd0e337b0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:11.552934 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4cc6ca54-aa3a-4fdb-bfbc-350cd0e337b0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:11.553380 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4cc6ca54-aa3a-4fdb-bfbc-350cd0e337b0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:11.554170 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4cc6ca54-aa3a-4fdb-bfbc-350cd0e337b0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:11.554564 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4cc6ca54-aa3a-4fdb-bfbc-350cd0e337b0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:11.672426 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-4cc6ca54-aa3a-4fdb-bfbc-350cd0e337b0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:11.679965 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-4cc6ca54-aa3a-4fdb-bfbc-350cd0e337b0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1756 microversion: 2.1 time: 0.137427 Oct 12 04:26:11.680523 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 516/1019] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:11 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1756 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:23.066398 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-3ca05ebe-f4c9-4099-9a3f-c7455c6e06b9 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:23.069494 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-3ca05ebe-f4c9-4099-9a3f-c7455c6e06b9 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:23.070118 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-b56e582c-ea1e-4d9c-993b-0a3d10b56376 req-e63665f1-c539-4f5c-8179-b477b8700980 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e51919f-b58c-4be5-8869-721e03482c90", "tag": "6126ee1a-6898-4a1c-af64-989fc7fae65a"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:26:23.072036 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:26:23.072036 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:26:23.073941 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3ca05ebe-f4c9-4099-9a3f-c7455c6e06b9 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:23.074373 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3ca05ebe-f4c9-4099-9a3f-c7455c6e06b9 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:23.075400 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3ca05ebe-f4c9-4099-9a3f-c7455c6e06b9 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:23.075922 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-3ca05ebe-f4c9-4099-9a3f-c7455c6e06b9 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:23.079764 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-b56e582c-ea1e-4d9c-993b-0a3d10b56376 req-e63665f1-c539-4f5c-8179-b477b8700980 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:23.080327 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-b56e582c-ea1e-4d9c-993b-0a3d10b56376 req-e63665f1-c539-4f5c-8179-b477b8700980 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:23.093680 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-b56e582c-ea1e-4d9c-993b-0a3d10b56376 req-e63665f1-c539-4f5c-8179-b477b8700980 service nova] Creating event network-changed:6126ee1a-6898-4a1c-af64-989fc7fae65a for instance 2e51919f-b58c-4be5-8869-721e03482c90 on hv-cinder-81306 Oct 12 04:26:23.100247 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-b56e582c-ea1e-4d9c-993b-0a3d10b56376 req-e63665f1-c539-4f5c-8179-b477b8700980 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034884 Oct 12 04:26:23.101661 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 517/1020] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:26:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:26:23.102640 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-3ca05ebe-f4c9-4099-9a3f-c7455c6e06b9 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Going to try to terminate instance {{(pid=108898) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 04:26:23.323167 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-3ca05ebe-f4c9-4099-9a3f-c7455c6e06b9 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "DELETE /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 204 len: 0 microversion: 2.1 time: 0.260298 Oct 12 04:26:23.324004 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 504/1021] 10.222.0.21 () {58 vars in 1238 bytes} [Tue Oct 12 04:26:23 2021] DELETE /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 04:26:23.332548 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ed00ecc5-7128-42c8-b5f9-b62e700839db tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:23.333411 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ed00ecc5-7128-42c8-b5f9-b62e700839db tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:23.339761 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ed00ecc5-7128-42c8-b5f9-b62e700839db tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:23.340197 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ed00ecc5-7128-42c8-b5f9-b62e700839db tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:23.341129 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ed00ecc5-7128-42c8-b5f9-b62e700839db tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:23.341726 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ed00ecc5-7128-42c8-b5f9-b62e700839db tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:23.550846 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-ed00ecc5-7128-42c8-b5f9-b62e700839db tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:23.567179 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ed00ecc5-7128-42c8-b5f9-b62e700839db tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1568 microversion: 2.1 time: 0.238434 Oct 12 04:26:23.577486 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 518/1022] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:23 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:24.585301 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-e1a285d8-61e4-46a6-86a3-22e271454565 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:24.586630 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-e1a285d8-61e4-46a6-86a3-22e271454565 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:24.592421 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e1a285d8-61e4-46a6-86a3-22e271454565 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:24.592867 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e1a285d8-61e4-46a6-86a3-22e271454565 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:24.593627 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e1a285d8-61e4-46a6-86a3-22e271454565 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:24.594054 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-e1a285d8-61e4-46a6-86a3-22e271454565 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:24.713999 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-e1a285d8-61e4-46a6-86a3-22e271454565 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:24.721097 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-e1a285d8-61e4-46a6-86a3-22e271454565 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1451 microversion: 2.1 time: 0.139857 Oct 12 04:26:24.721647 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 505/1023] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:24 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1451 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:25.738277 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-f4d12041-8362-4f38-beed-007229e89314 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:25.738903 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-f4d12041-8362-4f38-beed-007229e89314 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:25.744688 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f4d12041-8362-4f38-beed-007229e89314 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:25.745132 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f4d12041-8362-4f38-beed-007229e89314 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:25.745879 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f4d12041-8362-4f38-beed-007229e89314 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:25.746304 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-f4d12041-8362-4f38-beed-007229e89314 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:25.862554 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-f4d12041-8362-4f38-beed-007229e89314 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:25.869817 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-f4d12041-8362-4f38-beed-007229e89314 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1451 microversion: 2.1 time: 0.135232 Oct 12 04:26:25.870370 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 519/1024] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:25 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1451 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:26.886224 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-9ba600d8-6028-4711-a728-8b5fa267ae71 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:26.886860 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-9ba600d8-6028-4711-a728-8b5fa267ae71 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:26.892679 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9ba600d8-6028-4711-a728-8b5fa267ae71 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:26.893121 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9ba600d8-6028-4711-a728-8b5fa267ae71 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:26.893876 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9ba600d8-6028-4711-a728-8b5fa267ae71 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:26.894301 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-9ba600d8-6028-4711-a728-8b5fa267ae71 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:27.009325 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-9ba600d8-6028-4711-a728-8b5fa267ae71 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:27.016405 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-9ba600d8-6028-4711-a728-8b5fa267ae71 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1451 microversion: 2.1 time: 0.133767 Oct 12 04:26:27.016956 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 506/1025] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:26 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1451 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:28.033416 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-6733f9e3-5551-4549-9c40-1be1e9788e25 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:28.033997 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-6733f9e3-5551-4549-9c40-1be1e9788e25 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:28.039569 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6733f9e3-5551-4549-9c40-1be1e9788e25 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:28.040017 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6733f9e3-5551-4549-9c40-1be1e9788e25 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:28.040772 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6733f9e3-5551-4549-9c40-1be1e9788e25 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:28.041202 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6733f9e3-5551-4549-9c40-1be1e9788e25 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:28.126396 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-6733f9e3-5551-4549-9c40-1be1e9788e25 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:28.141353 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-6733f9e3-5551-4549-9c40-1be1e9788e25 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1384 microversion: 2.1 time: 0.111587 Oct 12 04:26:28.141938 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 520/1026] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:28 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1384 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:28.182108 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-380cefc7-8898-484b-ab23-76d9947d83a6 req-0b05ca0f-3e07-46a3-beea-9ba6f2a9660a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e51919f-b58c-4be5-8869-721e03482c90", "name": "network-vif-deleted", "tag": "6126ee1a-6898-4a1c-af64-989fc7fae65a"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:26:28.183715 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:26:28.183715 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:26:28.190409 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-380cefc7-8898-484b-ab23-76d9947d83a6 req-0b05ca0f-3e07-46a3-beea-9ba6f2a9660a service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:28.190875 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-380cefc7-8898-484b-ab23-76d9947d83a6 req-0b05ca0f-3e07-46a3-beea-9ba6f2a9660a service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:28.202546 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-380cefc7-8898-484b-ab23-76d9947d83a6 req-0b05ca0f-3e07-46a3-beea-9ba6f2a9660a service nova] Creating event network-vif-deleted:6126ee1a-6898-4a1c-af64-989fc7fae65a for instance 2e51919f-b58c-4be5-8869-721e03482c90 on hv-cinder-81306 Oct 12 04:26:28.207573 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-380cefc7-8898-484b-ab23-76d9947d83a6 req-0b05ca0f-3e07-46a3-beea-9ba6f2a9660a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029401 Oct 12 04:26:28.207843 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 507/1027] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:26:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:26:29.158110 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-632eb2ce-520c-471f-97cc-e88a582a2669 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:29.158740 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-632eb2ce-520c-471f-97cc-e88a582a2669 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:29.164566 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-632eb2ce-520c-471f-97cc-e88a582a2669 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:29.165016 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-632eb2ce-520c-471f-97cc-e88a582a2669 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:29.165773 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-632eb2ce-520c-471f-97cc-e88a582a2669 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:29.166207 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-632eb2ce-520c-471f-97cc-e88a582a2669 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:29.195885 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-632eb2ce-520c-471f-97cc-e88a582a2669 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:29.196332 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-632eb2ce-520c-471f-97cc-e88a582a2669 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:29.196778 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.objects.instance [None req-632eb2ce-520c-471f-97cc-e88a582a2669 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lazy-loading 'fault' on Instance uuid 2e51919f-b58c-4be5-8869-721e03482c90 {{(pid=108897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:26:29.235450 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-632eb2ce-520c-471f-97cc-e88a582a2669 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fefb7c10a94985a659a180ca85d560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a5619d6cc54f8cb1261bb15c0fa58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:29.242693 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-632eb2ce-520c-471f-97cc-e88a582a2669 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 200 len: 1225 microversion: 2.1 time: 0.088289 Oct 12 04:26:29.244026 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 521/1028] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:29 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:30.260156 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-c99b15c6-b1a9-4b53-99f8-408921378a98 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:30.260845 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-c99b15c6-b1a9-4b53-99f8-408921378a98 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] [instance: 2e51919f-b58c-4be5-8869-721e03482c90] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:30.266939 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c99b15c6-b1a9-4b53-99f8-408921378a98 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:30.267383 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c99b15c6-b1a9-4b53-99f8-408921378a98 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:30.268135 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c99b15c6-b1a9-4b53-99f8-408921378a98 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:30.268563 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c99b15c6-b1a9-4b53-99f8-408921378a98 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:30.281491 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.wsgi [None req-c99b15c6-b1a9-4b53-99f8-408921378a98 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] HTTP exception thrown: Instance 2e51919f-b58c-4be5-8869-721e03482c90 could not be found. Oct 12 04:26:30.289773 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-c99b15c6-b1a9-4b53-99f8-408921378a98 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Returning 404 to user: Instance 2e51919f-b58c-4be5-8869-721e03482c90 could not be found. {{(pid=108898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:26:30.289773 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-c99b15c6-b1a9-4b53-99f8-408921378a98 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90" status: 404 len: 111 microversion: 2.1 time: 0.026689 Oct 12 04:26:30.289773 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 508/1029] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:30 2021] GET /compute/v2.1/servers/2e51919f-b58c-4be5-8869-721e03482c90 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:26:30.503897 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-2dc78242-90f2-44ee-8453-ab43ef0793b4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] Calling method '.version_select at 0x7f3855dc4dc0>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:30.597818 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-2dc78242-90f2-44ee-8453-ab43ef0793b4 tempest-TestShelveInstance-675733104 tempest-TestShelveInstance-675733104-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1444809609" status: 202 len: 0 microversion: 2.1 time: 0.097466 Oct 12 04:26:30.598435 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 522/1030] 10.222.0.21 () {58 vars in 1253 bytes} [Tue Oct 12 04:26:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1444809609 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:26:31.630485 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-1efaf2f5-a455-4ad3-baa1-752a2dcf6a0b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:31.631062 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-1efaf2f5-a455-4ad3-baa1-752a2dcf6a0b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: 6ead9e5d-68f2-43dc-9d09-e224a01a05b4] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:31.637135 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1efaf2f5-a455-4ad3-baa1-752a2dcf6a0b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:31.637867 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1efaf2f5-a455-4ad3-baa1-752a2dcf6a0b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:31.638893 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1efaf2f5-a455-4ad3-baa1-752a2dcf6a0b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:31.639846 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1efaf2f5-a455-4ad3-baa1-752a2dcf6a0b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:31.725330 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.objects.instance [None req-1efaf2f5-a455-4ad3-baa1-752a2dcf6a0b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lazy-loading 'services' on Instance uuid 6ead9e5d-68f2-43dc-9d09-e224a01a05b4 {{(pid=108898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:26:31.915688 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-1efaf2f5-a455-4ad3-baa1-752a2dcf6a0b tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "DELETE /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4/os-volume_attachments/6a79c136-686d-4d19-81cd-e3a260592b78" status: 202 len: 0 microversion: 2.1 time: 0.288917 Oct 12 04:26:31.916333 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 509/1031] 10.222.0.21 () {58 vars in 1415 bytes} [Tue Oct 12 04:26:31 2021] DELETE /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4/os-volume_attachments/6a79c136-686d-4d19-81cd-e3a260592b78 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:26:33.030870 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-cc8a7814-f892-4a77-a921-14a0f499fcc9 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:33.031430 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-cc8a7814-f892-4a77-a921-14a0f499fcc9 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: 6ead9e5d-68f2-43dc-9d09-e224a01a05b4] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:33.037298 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-cc8a7814-f892-4a77-a921-14a0f499fcc9 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:33.037742 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-cc8a7814-f892-4a77-a921-14a0f499fcc9 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:33.038489 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-cc8a7814-f892-4a77-a921-14a0f499fcc9 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:33.038936 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-cc8a7814-f892-4a77-a921-14a0f499fcc9 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:33.063536 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-cc8a7814-f892-4a77-a921-14a0f499fcc9 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: 6ead9e5d-68f2-43dc-9d09-e224a01a05b4] Going to try to terminate instance {{(pid=108897) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 04:26:33.367855 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-cc8a7814-f892-4a77-a921-14a0f499fcc9 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "DELETE /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4" status: 204 len: 0 microversion: 2.1 time: 0.340890 Oct 12 04:26:33.368430 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 523/1032] 10.222.0.21 () {58 vars in 1238 bytes} [Tue Oct 12 04:26:33 2021] DELETE /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 04:26:33.378073 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-81232efa-0046-45b6-b3e7-0fb441c5dbcb tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:33.379388 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-81232efa-0046-45b6-b3e7-0fb441c5dbcb tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: 6ead9e5d-68f2-43dc-9d09-e224a01a05b4] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:33.388315 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-81232efa-0046-45b6-b3e7-0fb441c5dbcb tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:33.388315 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-81232efa-0046-45b6-b3e7-0fb441c5dbcb tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:33.388315 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-81232efa-0046-45b6-b3e7-0fb441c5dbcb tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:33.389250 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-81232efa-0046-45b6-b3e7-0fb441c5dbcb tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:33.595002 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-81232efa-0046-45b6-b3e7-0fb441c5dbcb tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:33.602233 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-81232efa-0046-45b6-b3e7-0fb441c5dbcb tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4" status: 200 len: 1514 microversion: 2.1 time: 0.228927 Oct 12 04:26:33.602892 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 510/1033] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:33 2021] GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4 => generated 1514 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:34.620174 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-8e330fac-6c96-4a60-a7a3-b33f5473c3e0 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:34.620874 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-8e330fac-6c96-4a60-a7a3-b33f5473c3e0 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: 6ead9e5d-68f2-43dc-9d09-e224a01a05b4] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:34.626497 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8e330fac-6c96-4a60-a7a3-b33f5473c3e0 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:34.626977 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8e330fac-6c96-4a60-a7a3-b33f5473c3e0 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:34.627741 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8e330fac-6c96-4a60-a7a3-b33f5473c3e0 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:34.628171 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8e330fac-6c96-4a60-a7a3-b33f5473c3e0 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:34.805669 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-8e330fac-6c96-4a60-a7a3-b33f5473c3e0 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:34.812879 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-8e330fac-6c96-4a60-a7a3-b33f5473c3e0 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4" status: 200 len: 1514 microversion: 2.1 time: 0.196772 Oct 12 04:26:34.813436 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 524/1034] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:34 2021] GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4 => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:35.830696 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-5962313e-82bb-4405-8ed7-0d0fb9549f65 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:35.834105 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-5962313e-82bb-4405-8ed7-0d0fb9549f65 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: 6ead9e5d-68f2-43dc-9d09-e224a01a05b4] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:35.844033 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5962313e-82bb-4405-8ed7-0d0fb9549f65 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:35.844483 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5962313e-82bb-4405-8ed7-0d0fb9549f65 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:35.845441 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5962313e-82bb-4405-8ed7-0d0fb9549f65 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:35.845880 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5962313e-82bb-4405-8ed7-0d0fb9549f65 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:35.925947 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-1883f9f4-22f4-464f-b037-6a5570964ba4 req-f2de7c7c-385a-4655-ae4b-a9940a230b80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ead9e5d-68f2-43dc-9d09-e224a01a05b4", "name": "network-vif-deleted", "tag": "a3222ba8-4a30-41a2-853f-668d4c53a0fe"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:26:35.927678 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:26:35.927678 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:26:35.935170 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-1883f9f4-22f4-464f-b037-6a5570964ba4 req-f2de7c7c-385a-4655-ae4b-a9940a230b80 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:35.935605 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-1883f9f4-22f4-464f-b037-6a5570964ba4 req-f2de7c7c-385a-4655-ae4b-a9940a230b80 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:35.945738 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-5962313e-82bb-4405-8ed7-0d0fb9549f65 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:35.947164 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-1883f9f4-22f4-464f-b037-6a5570964ba4 req-f2de7c7c-385a-4655-ae4b-a9940a230b80 service nova] Creating event network-vif-deleted:a3222ba8-4a30-41a2-853f-668d4c53a0fe for instance 6ead9e5d-68f2-43dc-9d09-e224a01a05b4 on hv-cinder-81306 Oct 12 04:26:35.952733 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-1883f9f4-22f4-464f-b037-6a5570964ba4 req-f2de7c7c-385a-4655-ae4b-a9940a230b80 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030593 Oct 12 04:26:35.953323 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 525/1035] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:26:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:26:35.955689 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-5962313e-82bb-4405-8ed7-0d0fb9549f65 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4" status: 200 len: 1472 microversion: 2.1 time: 0.128666 Oct 12 04:26:35.956893 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 511/1036] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:35 2021] GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4 => generated 1472 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:36.973745 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-6dfb4013-080a-4bfd-998c-373825d01d3d tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:36.974444 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-6dfb4013-080a-4bfd-998c-373825d01d3d tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: 6ead9e5d-68f2-43dc-9d09-e224a01a05b4] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:36.982588 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6dfb4013-080a-4bfd-998c-373825d01d3d tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:36.983062 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6dfb4013-080a-4bfd-998c-373825d01d3d tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:36.983837 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6dfb4013-080a-4bfd-998c-373825d01d3d tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:36.984276 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6dfb4013-080a-4bfd-998c-373825d01d3d tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:36.997170 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.wsgi [None req-6dfb4013-080a-4bfd-998c-373825d01d3d tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] HTTP exception thrown: Instance 6ead9e5d-68f2-43dc-9d09-e224a01a05b4 could not be found. Oct 12 04:26:36.997790 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-6dfb4013-080a-4bfd-998c-373825d01d3d tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Returning 404 to user: Instance 6ead9e5d-68f2-43dc-9d09-e224a01a05b4 could not be found. {{(pid=108897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:26:36.998608 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-6dfb4013-080a-4bfd-998c-373825d01d3d tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4" status: 404 len: 111 microversion: 2.1 time: 0.028967 Oct 12 04:26:36.999281 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 526/1037] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:36 2021] GET /compute/v2.1/servers/6ead9e5d-68f2-43dc-9d09-e224a01a05b4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:26:47.409733 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-aab8570c-fac9-4e06-82d6-4febbd5a00ab tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1330668476", "imageRef": "bf8c5573-3890-45dc-aec8-b1ad89136f80", "flavorRef": "452", "networks": [{"uuid": "cc0ecb2c-871a-4433-93b4-525087c5ea67"}]}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:26:47.457854 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.network.neutron [None req-aab8570c-fac9-4e06-82d6-4febbd5a00ab tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] validate_networks() for [('cc0ecb2c-871a-4433-93b4-525087c5ea67', None, None, None, None, None)] {{(pid=108898) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 04:26:47.796836 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-aab8570c-fac9-4e06-82d6-4febbd5a00ab tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Flavor limits 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 04:26:47.797260 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-aab8570c-fac9-4e06-82d6-4febbd5a00ab tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Image limits 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 04:26:47.797735 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-aab8570c-fac9-4e06-82d6-4febbd5a00ab tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Flavor pref 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 04:26:47.798189 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-aab8570c-fac9-4e06-82d6-4febbd5a00ab tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Image pref 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 04:26:47.798601 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-aab8570c-fac9-4e06-82d6-4febbd5a00ab tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 04:26:47.807330 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-aab8570c-fac9-4e06-82d6-4febbd5a00ab tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:47.810640 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-aab8570c-fac9-4e06-82d6-4febbd5a00ab tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:47.810640 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-aab8570c-fac9-4e06-82d6-4febbd5a00ab tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:47.810640 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-aab8570c-fac9-4e06-82d6-4febbd5a00ab tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:47.826190 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-aab8570c-fac9-4e06-82d6-4febbd5a00ab tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Getting quotas for project 350b2ff78dac4a14a12b78bb343d4195. Resources: {'cores', 'instances', 'ram'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:26:47.830261 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-aab8570c-fac9-4e06-82d6-4febbd5a00ab tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Getting quotas for user d61f561e270a4b658506d0a22f562dc8 and project 350b2ff78dac4a14a12b78bb343d4195. Resources: {'cores', 'instances', 'ram'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:26:47.841386 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-aab8570c-fac9-4e06-82d6-4febbd5a00ab tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Going to run 1 instances... {{(pid=108898) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 04:26:47.843709 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-aab8570c-fac9-4e06-82d6-4febbd5a00ab tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: cdcd70e1-7313-4f25-b52d-237f8de47c30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf8c5573-3890-45dc-aec8-b1ad89136f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108898) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 04:26:47.951459 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-aab8570c-fac9-4e06-82d6-4febbd5a00ab tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545215 Oct 12 04:26:47.952124 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 512/1038] 10.222.0.21 () {60 vars in 1146 bytes} [Tue Oct 12 04:26:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 04:26:47.962239 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-f2ecd9a0-041b-4c1f-864a-cd55b4369c4a tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:47.962854 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-f2ecd9a0-041b-4c1f-864a-cd55b4369c4a tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: cdcd70e1-7313-4f25-b52d-237f8de47c30] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:48.020589 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-f2ecd9a0-041b-4c1f-864a-cd55b4369c4a tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:48.026802 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-f2ecd9a0-041b-4c1f-864a-cd55b4369c4a tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30" status: 200 len: 1219 microversion: 2.1 time: 0.068431 Oct 12 04:26:48.027348 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 527/1039] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:47 2021] GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:49.043231 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-b0fe6486-fb3f-46df-95cf-8843ee3d0fa7 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:49.043835 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-b0fe6486-fb3f-46df-95cf-8843ee3d0fa7 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: cdcd70e1-7313-4f25-b52d-237f8de47c30] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:49.049820 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b0fe6486-fb3f-46df-95cf-8843ee3d0fa7 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:49.050262 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b0fe6486-fb3f-46df-95cf-8843ee3d0fa7 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:49.051128 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b0fe6486-fb3f-46df-95cf-8843ee3d0fa7 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:49.051607 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b0fe6486-fb3f-46df-95cf-8843ee3d0fa7 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:49.109638 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-b0fe6486-fb3f-46df-95cf-8843ee3d0fa7 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:49.116798 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-b0fe6486-fb3f-46df-95cf-8843ee3d0fa7 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30" status: 200 len: 1215 microversion: 2.1 time: 0.077823 Oct 12 04:26:49.117353 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 513/1040] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:49 2021] GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30 => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:50.137718 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-4ebf6c10-0ae3-4fc5-ba05-7ad8d4721b40 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:50.138405 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-4ebf6c10-0ae3-4fc5-ba05-7ad8d4721b40 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: cdcd70e1-7313-4f25-b52d-237f8de47c30] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:50.146928 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4ebf6c10-0ae3-4fc5-ba05-7ad8d4721b40 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:50.147377 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4ebf6c10-0ae3-4fc5-ba05-7ad8d4721b40 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:50.148142 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4ebf6c10-0ae3-4fc5-ba05-7ad8d4721b40 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:50.148577 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-4ebf6c10-0ae3-4fc5-ba05-7ad8d4721b40 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:50.386517 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-4ebf6c10-0ae3-4fc5-ba05-7ad8d4721b40 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:50.393837 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-4ebf6c10-0ae3-4fc5-ba05-7ad8d4721b40 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30" status: 200 len: 1277 microversion: 2.1 time: 0.259804 Oct 12 04:26:50.394387 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 528/1041] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:50 2021] GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30 => generated 1277 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:50.618879 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-0e631e70-5280-4edf-bd87-614c5be9bf9f tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-86159551"}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:26:50.619424 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-0e631e70-5280-4edf-bd87-614c5be9bf9f tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:50.625084 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0e631e70-5280-4edf-bd87-614c5be9bf9f tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:50.627087 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0e631e70-5280-4edf-bd87-614c5be9bf9f tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:50.627087 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0e631e70-5280-4edf-bd87-614c5be9bf9f tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:50.627087 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-0e631e70-5280-4edf-bd87-614c5be9bf9f tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:50.861537 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.network.security_group_api [None req-0e631e70-5280-4edf-bd87-614c5be9bf9f tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Removing security group 4a9ab858-e066-4708-8f2e-376771ac5089 from port 6f4c91da-c3ba-4145-9177-bc95323a2b78 Oct 12 04:26:51.423466 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-0e631e70-5280-4edf-bd87-614c5be9bf9f tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "POST /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a/action" status: 202 len: 0 microversion: 2.1 time: 0.803863 Oct 12 04:26:51.423589 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-9c5099b8-1ce2-4a45-a978-872a2e6ac0ba tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:51.424436 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 514/1042] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Oct 12 04:26:50 2021] POST /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a/action => generated 0 bytes in 805 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 04:26:51.424546 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-9c5099b8-1ce2-4a45-a978-872a2e6ac0ba tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: cdcd70e1-7313-4f25-b52d-237f8de47c30] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:51.430050 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9c5099b8-1ce2-4a45-a978-872a2e6ac0ba tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:51.430308 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-5306aa56-3afe-4d91-b3f4-0656c55eac26 req-9243e3a9-8ae7-4e11-a67a-eeaf17ac9247 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d64ca24e-5bd0-4420-89d5-beb55714d12a", "tag": "6f4c91da-c3ba-4145-9177-bc95323a2b78"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:26:51.431718 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9c5099b8-1ce2-4a45-a978-872a2e6ac0ba tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:51.432963 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:26:51.432963 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:26:51.433928 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9c5099b8-1ce2-4a45-a978-872a2e6ac0ba tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:51.434516 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-9c5099b8-1ce2-4a45-a978-872a2e6ac0ba tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:51.449095 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-5306aa56-3afe-4d91-b3f4-0656c55eac26 req-9243e3a9-8ae7-4e11-a67a-eeaf17ac9247 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:51.452156 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-5306aa56-3afe-4d91-b3f4-0656c55eac26 req-9243e3a9-8ae7-4e11-a67a-eeaf17ac9247 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:51.484206 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-5306aa56-3afe-4d91-b3f4-0656c55eac26 req-9243e3a9-8ae7-4e11-a67a-eeaf17ac9247 service nova] Creating event network-changed:6f4c91da-c3ba-4145-9177-bc95323a2b78 for instance d64ca24e-5bd0-4420-89d5-beb55714d12a on hv-cinder-81306 Oct 12 04:26:51.501625 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-5306aa56-3afe-4d91-b3f4-0656c55eac26 req-9243e3a9-8ae7-4e11-a67a-eeaf17ac9247 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075236 Oct 12 04:26:51.503180 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 515/1043] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:26:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:26:51.710963 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-9c5099b8-1ce2-4a45-a978-872a2e6ac0ba tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:51.723809 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-9c5099b8-1ce2-4a45-a978-872a2e6ac0ba tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30" status: 200 len: 1319 microversion: 2.1 time: 0.310739 Oct 12 04:26:51.726208 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 529/1044] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:51 2021] GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30 => generated 1319 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:52.742657 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-97509999-2a6b-4c07-a2ad-8ae45d931ea6 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:52.743510 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-97509999-2a6b-4c07-a2ad-8ae45d931ea6 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: cdcd70e1-7313-4f25-b52d-237f8de47c30] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:52.749917 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-97509999-2a6b-4c07-a2ad-8ae45d931ea6 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:52.750450 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-97509999-2a6b-4c07-a2ad-8ae45d931ea6 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:52.751243 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-97509999-2a6b-4c07-a2ad-8ae45d931ea6 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:52.751680 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-97509999-2a6b-4c07-a2ad-8ae45d931ea6 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:53.209780 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-97509999-2a6b-4c07-a2ad-8ae45d931ea6 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:53.217605 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-97509999-2a6b-4c07-a2ad-8ae45d931ea6 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30" status: 200 len: 1319 microversion: 2.1 time: 0.478896 Oct 12 04:26:53.218180 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 516/1045] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:52 2021] GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30 => generated 1319 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:53.265812 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-a9ddf8b6-662a-408b-9bfe-06ec8628e17d tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:53.266307 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-a9ddf8b6-662a-408b-9bfe-06ec8628e17d tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:53.272065 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a9ddf8b6-662a-408b-9bfe-06ec8628e17d tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:53.272512 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a9ddf8b6-662a-408b-9bfe-06ec8628e17d tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:53.273270 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a9ddf8b6-662a-408b-9bfe-06ec8628e17d tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:53.273702 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a9ddf8b6-662a-408b-9bfe-06ec8628e17d tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:53.351891 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.objects.instance [None req-a9ddf8b6-662a-408b-9bfe-06ec8628e17d tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lazy-loading 'services' on Instance uuid d64ca24e-5bd0-4420-89d5-beb55714d12a {{(pid=108897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:26:53.520924 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-a9ddf8b6-662a-408b-9bfe-06ec8628e17d tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "DELETE /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a/os-volume_attachments/10338c4f-46c1-4a18-95a3-8b8e76bd4ccf" status: 202 len: 0 microversion: 2.1 time: 0.258653 Oct 12 04:26:53.521960 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 530/1046] 10.222.0.21 () {58 vars in 1415 bytes} [Tue Oct 12 04:26:53 2021] DELETE /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a/os-volume_attachments/10338c4f-46c1-4a18-95a3-8b8e76bd4ccf => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:26:53.530169 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-776d0fb6-9140-4ea7-b98b-56c0a72102ac req-3b3785f1-5e4f-480c-86bf-b629817b15d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdcd70e1-7313-4f25-b52d-237f8de47c30", "tag": "7c642561-ffae-458e-984d-784561c651d6"}, {"name": "network-changed", "server_uuid": "d64ca24e-5bd0-4420-89d5-beb55714d12a", "tag": "6f4c91da-c3ba-4145-9177-bc95323a2b78"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:26:53.531214 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-5f48ce01-e995-4bcd-938a-4a257b0ffbb0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:53.531958 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:26:53.531958 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:26:53.532339 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-5f48ce01-e995-4bcd-938a-4a257b0ffbb0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:53.539880 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5f48ce01-e995-4bcd-938a-4a257b0ffbb0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:53.540086 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-776d0fb6-9140-4ea7-b98b-56c0a72102ac req-3b3785f1-5e4f-480c-86bf-b629817b15d0 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:53.540328 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5f48ce01-e995-4bcd-938a-4a257b0ffbb0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:53.540643 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-776d0fb6-9140-4ea7-b98b-56c0a72102ac req-3b3785f1-5e4f-480c-86bf-b629817b15d0 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:53.541094 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5f48ce01-e995-4bcd-938a-4a257b0ffbb0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:53.542262 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5f48ce01-e995-4bcd-938a-4a257b0ffbb0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:53.554651 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-776d0fb6-9140-4ea7-b98b-56c0a72102ac req-3b3785f1-5e4f-480c-86bf-b629817b15d0 service nova] Creating event network-changed:7c642561-ffae-458e-984d-784561c651d6 for instance cdcd70e1-7313-4f25-b52d-237f8de47c30 on hv-cinder-81306 Oct 12 04:26:53.555179 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-776d0fb6-9140-4ea7-b98b-56c0a72102ac req-3b3785f1-5e4f-480c-86bf-b629817b15d0 service nova] Creating event network-changed:6f4c91da-c3ba-4145-9177-bc95323a2b78 for instance d64ca24e-5bd0-4420-89d5-beb55714d12a on hv-cinder-81306 Oct 12 04:26:53.562143 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-776d0fb6-9140-4ea7-b98b-56c0a72102ac req-3b3785f1-5e4f-480c-86bf-b629817b15d0 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036010 Oct 12 04:26:53.563409 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 517/1047] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:26:53 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:26:53.571824 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-5f48ce01-e995-4bcd-938a-4a257b0ffbb0 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045221 Oct 12 04:26:53.572374 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 531/1048] 10.222.0.21 () {58 vars in 1301 bytes} [Tue Oct 12 04:26:53 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:26:54.236538 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-ee1da89d-a7d9-4af5-b88d-a8de79481296 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:54.237374 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-ee1da89d-a7d9-4af5-b88d-a8de79481296 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: cdcd70e1-7313-4f25-b52d-237f8de47c30] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:54.245316 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ee1da89d-a7d9-4af5-b88d-a8de79481296 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:54.249865 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ee1da89d-a7d9-4af5-b88d-a8de79481296 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:54.249865 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ee1da89d-a7d9-4af5-b88d-a8de79481296 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:54.249865 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ee1da89d-a7d9-4af5-b88d-a8de79481296 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:54.432865 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-ee1da89d-a7d9-4af5-b88d-a8de79481296 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:54.440007 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-ee1da89d-a7d9-4af5-b88d-a8de79481296 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30" status: 200 len: 1319 microversion: 2.1 time: 0.209856 Oct 12 04:26:54.440571 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 518/1049] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:54 2021] GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:54.584753 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-39004ce1-4fde-422f-a255-00966e1e30ca tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:54.585889 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-39004ce1-4fde-422f-a255-00966e1e30ca tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:54.591601 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-39004ce1-4fde-422f-a255-00966e1e30ca tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:54.592049 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-39004ce1-4fde-422f-a255-00966e1e30ca tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:54.592809 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-39004ce1-4fde-422f-a255-00966e1e30ca tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:54.593244 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-39004ce1-4fde-422f-a255-00966e1e30ca tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:54.622026 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-39004ce1-4fde-422f-a255-00966e1e30ca tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041090 Oct 12 04:26:54.622572 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 532/1050] 10.222.0.21 () {58 vars in 1301 bytes} [Tue Oct 12 04:26:54 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 04:26:54.632146 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-81964536-23cc-4923-bcd8-f1e6b0009e55 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:54.632636 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-81964536-23cc-4923-bcd8-f1e6b0009e55 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:54.638302 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-81964536-23cc-4923-bcd8-f1e6b0009e55 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:54.638782 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-81964536-23cc-4923-bcd8-f1e6b0009e55 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:54.639542 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-81964536-23cc-4923-bcd8-f1e6b0009e55 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:54.639969 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-81964536-23cc-4923-bcd8-f1e6b0009e55 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:54.709170 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.wsgi [None req-81964536-23cc-4923-bcd8-f1e6b0009e55 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] HTTP exception thrown: Instance d64ca24e-5bd0-4420-89d5-beb55714d12a is not attached to volume 10338c4f-46c1-4a18-95a3-8b8e76bd4ccf Oct 12 04:26:54.711261 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-81964536-23cc-4923-bcd8-f1e6b0009e55 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Returning 404 to user: Instance d64ca24e-5bd0-4420-89d5-beb55714d12a is not attached to volume 10338c4f-46c1-4a18-95a3-8b8e76bd4ccf {{(pid=108898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:26:54.711261 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-81964536-23cc-4923-bcd8-f1e6b0009e55 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "DELETE /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a/os-volume_attachments/10338c4f-46c1-4a18-95a3-8b8e76bd4ccf" status: 404 len: 154 microversion: 2.1 time: 0.082226 Oct 12 04:26:54.711261 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 519/1051] 10.222.0.21 () {58 vars in 1415 bytes} [Tue Oct 12 04:26:54 2021] DELETE /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a/os-volume_attachments/10338c4f-46c1-4a18-95a3-8b8e76bd4ccf => generated 154 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:26:55.456444 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-deb2421d-5243-443a-88fd-5f10e706eefa tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:55.457058 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-deb2421d-5243-443a-88fd-5f10e706eefa tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: cdcd70e1-7313-4f25-b52d-237f8de47c30] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:55.463009 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-deb2421d-5243-443a-88fd-5f10e706eefa tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:55.463499 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-deb2421d-5243-443a-88fd-5f10e706eefa tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:55.464265 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-deb2421d-5243-443a-88fd-5f10e706eefa tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:55.464698 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-deb2421d-5243-443a-88fd-5f10e706eefa tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:55.583518 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-deb2421d-5243-443a-88fd-5f10e706eefa tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:55.590528 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-deb2421d-5243-443a-88fd-5f10e706eefa tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30" status: 200 len: 1319 microversion: 2.1 time: 0.137880 Oct 12 04:26:55.591113 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 533/1052] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:55 2021] GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30 => generated 1319 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:56.010025 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-82e4fd35-2100-431d-986c-3b77c5976a2a tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:56.010805 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-82e4fd35-2100-431d-986c-3b77c5976a2a tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:56.016845 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-82e4fd35-2100-431d-986c-3b77c5976a2a tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:56.017291 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-82e4fd35-2100-431d-986c-3b77c5976a2a tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:56.018055 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-82e4fd35-2100-431d-986c-3b77c5976a2a tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:56.018484 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-82e4fd35-2100-431d-986c-3b77c5976a2a tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:56.042156 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-82e4fd35-2100-431d-986c-3b77c5976a2a tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Going to try to terminate instance {{(pid=108898) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 04:26:56.252757 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-82e4fd35-2100-431d-986c-3b77c5976a2a tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "DELETE /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 204 len: 0 microversion: 2.1 time: 0.248388 Oct 12 04:26:56.253324 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 520/1053] 10.222.0.21 () {58 vars in 1238 bytes} [Tue Oct 12 04:26:56 2021] DELETE /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 04:26:56.261328 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-36f72c48-f9b7-45f1-ac13-a0bec21eb5a9 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:56.261992 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-36f72c48-f9b7-45f1-ac13-a0bec21eb5a9 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:56.268124 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-36f72c48-f9b7-45f1-ac13-a0bec21eb5a9 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:56.268569 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-36f72c48-f9b7-45f1-ac13-a0bec21eb5a9 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:56.274956 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-36f72c48-f9b7-45f1-ac13-a0bec21eb5a9 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:56.274956 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-36f72c48-f9b7-45f1-ac13-a0bec21eb5a9 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:56.385912 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-36f72c48-f9b7-45f1-ac13-a0bec21eb5a9 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:56.393040 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-36f72c48-f9b7-45f1-ac13-a0bec21eb5a9 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1554 microversion: 2.1 time: 0.135432 Oct 12 04:26:56.393587 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 534/1054] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:56 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1554 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:56.607918 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-2f5929a0-b620-4933-aef1-70d9d35c0903 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:56.608608 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-2f5929a0-b620-4933-aef1-70d9d35c0903 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: cdcd70e1-7313-4f25-b52d-237f8de47c30] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:56.614170 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2f5929a0-b620-4933-aef1-70d9d35c0903 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:56.614608 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2f5929a0-b620-4933-aef1-70d9d35c0903 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:56.615400 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2f5929a0-b620-4933-aef1-70d9d35c0903 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:56.615831 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-2f5929a0-b620-4933-aef1-70d9d35c0903 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:56.744044 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-2f5929a0-b620-4933-aef1-70d9d35c0903 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:56.751738 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-2f5929a0-b620-4933-aef1-70d9d35c0903 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30" status: 200 len: 1319 microversion: 2.1 time: 0.147821 Oct 12 04:26:56.752518 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 521/1055] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:56 2021] GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:57.410046 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-6d035db8-faa7-42c0-a963-fe8bbb0eb779 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:57.410649 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-6d035db8-faa7-42c0-a963-fe8bbb0eb779 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:57.417017 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6d035db8-faa7-42c0-a963-fe8bbb0eb779 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:57.417450 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6d035db8-faa7-42c0-a963-fe8bbb0eb779 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:57.418194 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6d035db8-faa7-42c0-a963-fe8bbb0eb779 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:57.418618 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6d035db8-faa7-42c0-a963-fe8bbb0eb779 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:57.533724 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-6d035db8-faa7-42c0-a963-fe8bbb0eb779 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:57.540790 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-6d035db8-faa7-42c0-a963-fe8bbb0eb779 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1554 microversion: 2.1 time: 0.134390 Oct 12 04:26:57.541873 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 535/1056] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:57 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1554 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:57.768679 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-483d93c1-0fcf-4086-aca9-93dcad76c813 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:57.769280 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-483d93c1-0fcf-4086-aca9-93dcad76c813 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: cdcd70e1-7313-4f25-b52d-237f8de47c30] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:57.775037 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-483d93c1-0fcf-4086-aca9-93dcad76c813 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:57.775458 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-483d93c1-0fcf-4086-aca9-93dcad76c813 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:57.776789 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-483d93c1-0fcf-4086-aca9-93dcad76c813 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:57.777212 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-483d93c1-0fcf-4086-aca9-93dcad76c813 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:57.892920 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-483d93c1-0fcf-4086-aca9-93dcad76c813 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:57.899903 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-483d93c1-0fcf-4086-aca9-93dcad76c813 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30" status: 200 len: 1319 microversion: 2.1 time: 0.134823 Oct 12 04:26:57.900452 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 522/1057] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:57 2021] GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30 => generated 1319 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:58.506688 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-5a8f8eab-c51a-4e64-8192-e2ac060d00f1 req-dce5cb34-96a4-40b4-8540-aa5382a431b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d64ca24e-5bd0-4420-89d5-beb55714d12a", "name": "network-vif-deleted", "tag": "6f4c91da-c3ba-4145-9177-bc95323a2b78"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:26:58.508225 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:26:58.508225 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:26:58.515401 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-5a8f8eab-c51a-4e64-8192-e2ac060d00f1 req-dce5cb34-96a4-40b4-8540-aa5382a431b5 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:58.515834 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-5a8f8eab-c51a-4e64-8192-e2ac060d00f1 req-dce5cb34-96a4-40b4-8540-aa5382a431b5 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:58.526297 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-5a8f8eab-c51a-4e64-8192-e2ac060d00f1 req-dce5cb34-96a4-40b4-8540-aa5382a431b5 service nova] Creating event network-vif-deleted:6f4c91da-c3ba-4145-9177-bc95323a2b78 for instance d64ca24e-5bd0-4420-89d5-beb55714d12a on hv-cinder-81306 Oct 12 04:26:58.531252 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-5a8f8eab-c51a-4e64-8192-e2ac060d00f1 req-dce5cb34-96a4-40b4-8540-aa5382a431b5 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028114 Oct 12 04:26:58.531816 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 536/1058] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:26:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:26:58.557388 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-b1a000f6-fdae-46c2-9e00-3d4b6aac310c tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:58.558003 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-b1a000f6-fdae-46c2-9e00-3d4b6aac310c tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:58.563684 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b1a000f6-fdae-46c2-9e00-3d4b6aac310c tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:58.564125 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b1a000f6-fdae-46c2-9e00-3d4b6aac310c tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:58.564877 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b1a000f6-fdae-46c2-9e00-3d4b6aac310c tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:58.565304 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b1a000f6-fdae-46c2-9e00-3d4b6aac310c tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:58.676601 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-b1a000f6-fdae-46c2-9e00-3d4b6aac310c tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f580515aad24e708c5dc02b7075328b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393591f50e945b092623c525b160733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:58.684403 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-b1a000f6-fdae-46c2-9e00-3d4b6aac310c tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 200 len: 1512 microversion: 2.1 time: 0.131080 Oct 12 04:26:58.684956 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 523/1059] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:58 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 1512 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:58.751187 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-7a2c720d-a6c1-4794-9aa4-9ae4d1949f68 req-450c4151-286e-4543-ac9e-00264c90ed91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdcd70e1-7313-4f25-b52d-237f8de47c30", "name": "network-vif-plugged", "status": "completed", "tag": "7c642561-ffae-458e-984d-784561c651d6"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:26:58.752948 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:26:58.752948 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:26:58.764761 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-7a2c720d-a6c1-4794-9aa4-9ae4d1949f68 req-450c4151-286e-4543-ac9e-00264c90ed91 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:58.765201 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-7a2c720d-a6c1-4794-9aa4-9ae4d1949f68 req-450c4151-286e-4543-ac9e-00264c90ed91 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:58.775601 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-7a2c720d-a6c1-4794-9aa4-9ae4d1949f68 req-450c4151-286e-4543-ac9e-00264c90ed91 service nova] Creating event network-vif-plugged:7c642561-ffae-458e-984d-784561c651d6 for instance cdcd70e1-7313-4f25-b52d-237f8de47c30 on hv-cinder-81306 Oct 12 04:26:58.780861 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-7a2c720d-a6c1-4794-9aa4-9ae4d1949f68 req-450c4151-286e-4543-ac9e-00264c90ed91 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033428 Oct 12 04:26:58.781597 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 537/1060] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:26:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:26:58.917416 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-be2fa857-0880-42dd-bfdd-e2c794d55a89 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:58.918119 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-be2fa857-0880-42dd-bfdd-e2c794d55a89 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: cdcd70e1-7313-4f25-b52d-237f8de47c30] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:58.924111 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-be2fa857-0880-42dd-bfdd-e2c794d55a89 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:58.924491 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-be2fa857-0880-42dd-bfdd-e2c794d55a89 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:58.925271 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-be2fa857-0880-42dd-bfdd-e2c794d55a89 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:58.925759 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-be2fa857-0880-42dd-bfdd-e2c794d55a89 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:59.050423 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-be2fa857-0880-42dd-bfdd-e2c794d55a89 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:26:59.058487 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-be2fa857-0880-42dd-bfdd-e2c794d55a89 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30" status: 200 len: 1319 microversion: 2.1 time: 0.145216 Oct 12 04:26:59.059093 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 524/1061] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:58 2021] GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:26:59.702015 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-a40cac52-a89a-4d00-a6a0-5c7fac719a03 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:59.702720 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-a40cac52-a89a-4d00-a6a0-5c7fac719a03 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] [instance: d64ca24e-5bd0-4420-89d5-beb55714d12a] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:26:59.708838 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a40cac52-a89a-4d00-a6a0-5c7fac719a03 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:59.709442 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a40cac52-a89a-4d00-a6a0-5c7fac719a03 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:59.710194 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a40cac52-a89a-4d00-a6a0-5c7fac719a03 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:26:59.710649 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-a40cac52-a89a-4d00-a6a0-5c7fac719a03 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:26:59.724330 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.wsgi [None req-a40cac52-a89a-4d00-a6a0-5c7fac719a03 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] HTTP exception thrown: Instance d64ca24e-5bd0-4420-89d5-beb55714d12a could not be found. Oct 12 04:26:59.724899 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-a40cac52-a89a-4d00-a6a0-5c7fac719a03 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Returning 404 to user: Instance d64ca24e-5bd0-4420-89d5-beb55714d12a could not be found. {{(pid=108897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:26:59.725688 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-a40cac52-a89a-4d00-a6a0-5c7fac719a03 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a" status: 404 len: 111 microversion: 2.1 time: 0.028160 Oct 12 04:26:59.726183 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 538/1062] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:26:59 2021] GET /compute/v2.1/servers/d64ca24e-5bd0-4420-89d5-beb55714d12a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:26:59.734279 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-ff0db54f-19f2-48fb-b3ea-f4498408e930 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] Calling method '.version_select at 0x7f38555cd700>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:26:59.836940 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-ff0db54f-19f2-48fb-b3ea-f4498408e930 tempest-TestMinimumBasicScenario-833581761 tempest-TestMinimumBasicScenario-833581761-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-694452061" status: 202 len: 0 microversion: 2.1 time: 0.106263 Oct 12 04:26:59.837497 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 525/1063] 10.222.0.21 () {58 vars in 1268 bytes} [Tue Oct 12 04:26:59 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-694452061 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:27:00.076298 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-70566983-e5f0-4df6-8d37-9efe8eac9288 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:27:00.076933 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-70566983-e5f0-4df6-8d37-9efe8eac9288 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: cdcd70e1-7313-4f25-b52d-237f8de47c30] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:27:00.083189 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-70566983-e5f0-4df6-8d37-9efe8eac9288 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:27:00.083633 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-70566983-e5f0-4df6-8d37-9efe8eac9288 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:27:00.084392 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-70566983-e5f0-4df6-8d37-9efe8eac9288 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:27:00.084822 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-70566983-e5f0-4df6-8d37-9efe8eac9288 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:27:00.212280 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-70566983-e5f0-4df6-8d37-9efe8eac9288 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:27:00.219411 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-70566983-e5f0-4df6-8d37-9efe8eac9288 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30" status: 200 len: 1319 microversion: 2.1 time: 0.147946 Oct 12 04:27:00.220188 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 539/1064] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:27:00 2021] GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:27:01.236263 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-f8420fd8-d1f3-459a-bdd1-891629904faa tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:27:01.236856 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-f8420fd8-d1f3-459a-bdd1-891629904faa tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: cdcd70e1-7313-4f25-b52d-237f8de47c30] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:27:01.242519 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f8420fd8-d1f3-459a-bdd1-891629904faa tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:27:01.242992 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f8420fd8-d1f3-459a-bdd1-891629904faa tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:27:01.243739 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f8420fd8-d1f3-459a-bdd1-891629904faa tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:27:01.244157 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f8420fd8-d1f3-459a-bdd1-891629904faa tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:27:01.402701 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-f8420fd8-d1f3-459a-bdd1-891629904faa tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:27:01.409884 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-f8420fd8-d1f3-459a-bdd1-891629904faa tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30" status: 200 len: 1507 microversion: 2.1 time: 0.177288 Oct 12 04:27:01.410439 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 526/1065] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:27:01 2021] GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30 => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:27:01.426111 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-87645674-7f5a-4791-b3d1-b35e49ab1439 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76340ba3-d4cb-4e64-821e-c49dcbf0cc13", "device": "/dev/sdb"}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:27:01.427261 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-87645674-7f5a-4791-b3d1-b35e49ab1439 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: cdcd70e1-7313-4f25-b52d-237f8de47c30] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:27:01.433457 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-87645674-7f5a-4791-b3d1-b35e49ab1439 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:27:01.433901 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-87645674-7f5a-4791-b3d1-b35e49ab1439 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:27:01.434647 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-87645674-7f5a-4791-b3d1-b35e49ab1439 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:27:01.435098 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-87645674-7f5a-4791-b3d1-b35e49ab1439 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:27:02.103810 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-87645674-7f5a-4791-b3d1-b35e49ab1439 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "POST /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.680250 Oct 12 04:27:02.104773 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 540/1066] 10.222.0.21 () {60 vars in 1322 bytes} [Tue Oct 12 04:27:01 2021] POST /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30/os-volume_attachments => generated 194 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:27:22.111125 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-4d6655f1-dee1-4ccb-b3b8-09f834075b2c tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:27:22.111598 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-4d6655f1-dee1-4ccb-b3b8-09f834075b2c tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: cdcd70e1-7313-4f25-b52d-237f8de47c30] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:27:22.117297 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4d6655f1-dee1-4ccb-b3b8-09f834075b2c tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:27:22.117735 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4d6655f1-dee1-4ccb-b3b8-09f834075b2c tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:27:22.118481 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4d6655f1-dee1-4ccb-b3b8-09f834075b2c tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:27:22.118935 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4d6655f1-dee1-4ccb-b3b8-09f834075b2c tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:27:22.191947 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.objects.instance [None req-4d6655f1-dee1-4ccb-b3b8-09f834075b2c tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lazy-loading 'services' on Instance uuid cdcd70e1-7313-4f25-b52d-237f8de47c30 {{(pid=108898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:27:22.407188 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-4d6655f1-dee1-4ccb-b3b8-09f834075b2c tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "DELETE /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30/os-volume_attachments/76340ba3-d4cb-4e64-821e-c49dcbf0cc13" status: 202 len: 0 microversion: 2.1 time: 0.299211 Oct 12 04:27:22.407904 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 527/1067] 10.222.0.21 () {58 vars in 1415 bytes} [Tue Oct 12 04:27:22 2021] DELETE /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30/os-volume_attachments/76340ba3-d4cb-4e64-821e-c49dcbf0cc13 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:27:23.510442 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-8b8846ef-2d16-4e37-8407-612242b75adc tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:27:23.511040 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-8b8846ef-2d16-4e37-8407-612242b75adc tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: cdcd70e1-7313-4f25-b52d-237f8de47c30] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:27:23.517396 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8b8846ef-2d16-4e37-8407-612242b75adc tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:27:23.517841 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8b8846ef-2d16-4e37-8407-612242b75adc tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:27:23.518590 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8b8846ef-2d16-4e37-8407-612242b75adc tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:27:23.519037 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8b8846ef-2d16-4e37-8407-612242b75adc tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:27:23.543681 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-8b8846ef-2d16-4e37-8407-612242b75adc tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: cdcd70e1-7313-4f25-b52d-237f8de47c30] Going to try to terminate instance {{(pid=108897) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 04:27:23.801126 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-8b8846ef-2d16-4e37-8407-612242b75adc tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "DELETE /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30" status: 204 len: 0 microversion: 2.1 time: 0.294511 Oct 12 04:27:23.801705 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 541/1068] 10.222.0.21 () {58 vars in 1238 bytes} [Tue Oct 12 04:27:23 2021] DELETE /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 04:27:23.810128 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-41ff4984-8a81-4afc-ad0e-c92c466e3287 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:27:23.810945 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-41ff4984-8a81-4afc-ad0e-c92c466e3287 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: cdcd70e1-7313-4f25-b52d-237f8de47c30] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:27:23.817096 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-41ff4984-8a81-4afc-ad0e-c92c466e3287 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:27:23.818438 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-41ff4984-8a81-4afc-ad0e-c92c466e3287 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:27:23.818438 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-41ff4984-8a81-4afc-ad0e-c92c466e3287 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:27:23.818764 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-41ff4984-8a81-4afc-ad0e-c92c466e3287 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:27:23.941305 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-41ff4984-8a81-4afc-ad0e-c92c466e3287 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:27:23.949325 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-41ff4984-8a81-4afc-ad0e-c92c466e3287 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30" status: 200 len: 1513 microversion: 2.1 time: 0.143116 Oct 12 04:27:23.949864 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 528/1069] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:27:23 2021] GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30 => generated 1513 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:27:24.967299 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-06d02407-7072-4062-8950-6766551c67a4 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:27:24.968001 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-06d02407-7072-4062-8950-6766551c67a4 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: cdcd70e1-7313-4f25-b52d-237f8de47c30] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:27:24.973800 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-06d02407-7072-4062-8950-6766551c67a4 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:27:24.974250 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-06d02407-7072-4062-8950-6766551c67a4 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:27:24.975045 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-06d02407-7072-4062-8950-6766551c67a4 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:27:24.975476 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-06d02407-7072-4062-8950-6766551c67a4 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:27:25.092447 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-06d02407-7072-4062-8950-6766551c67a4 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:27:25.099566 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-06d02407-7072-4062-8950-6766551c67a4 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30" status: 200 len: 1513 microversion: 2.1 time: 0.136819 Oct 12 04:27:25.100119 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 542/1070] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:27:24 2021] GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30 => generated 1513 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:27:26.056146 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-6908346f-b0ae-4ec4-b8ac-469954840b5e req-b6ec0dfd-b3aa-4b78-857e-c0b8a3e00ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdcd70e1-7313-4f25-b52d-237f8de47c30", "name": "network-vif-deleted", "tag": "7c642561-ffae-458e-984d-784561c651d6"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:27:26.058349 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:27:26.058349 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:27:26.064990 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-6908346f-b0ae-4ec4-b8ac-469954840b5e req-b6ec0dfd-b3aa-4b78-857e-c0b8a3e00ed9 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:27:26.065429 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-6908346f-b0ae-4ec4-b8ac-469954840b5e req-b6ec0dfd-b3aa-4b78-857e-c0b8a3e00ed9 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:27:26.076945 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-6908346f-b0ae-4ec4-b8ac-469954840b5e req-b6ec0dfd-b3aa-4b78-857e-c0b8a3e00ed9 service nova] Creating event network-vif-deleted:7c642561-ffae-458e-984d-784561c651d6 for instance cdcd70e1-7313-4f25-b52d-237f8de47c30 on hv-cinder-81306 Oct 12 04:27:26.082002 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-6908346f-b0ae-4ec4-b8ac-469954840b5e req-b6ec0dfd-b3aa-4b78-857e-c0b8a3e00ed9 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199965 Oct 12 04:27:26.083181 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 529/1071] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:27:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:27:26.116515 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-e3a32a44-0595-4fea-bfcf-6c17e18db3c0 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:27:26.117119 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-e3a32a44-0595-4fea-bfcf-6c17e18db3c0 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: cdcd70e1-7313-4f25-b52d-237f8de47c30] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:27:26.123842 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e3a32a44-0595-4fea-bfcf-6c17e18db3c0 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:27:26.124282 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e3a32a44-0595-4fea-bfcf-6c17e18db3c0 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:27:26.125047 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e3a32a44-0595-4fea-bfcf-6c17e18db3c0 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:27:26.125476 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e3a32a44-0595-4fea-bfcf-6c17e18db3c0 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:27:26.155827 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e3a32a44-0595-4fea-bfcf-6c17e18db3c0 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:27:26.156263 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e3a32a44-0595-4fea-bfcf-6c17e18db3c0 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:27:26.156743 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.objects.instance [None req-e3a32a44-0595-4fea-bfcf-6c17e18db3c0 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lazy-loading 'fault' on Instance uuid cdcd70e1-7313-4f25-b52d-237f8de47c30 {{(pid=108897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:27:26.195393 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-e3a32a44-0595-4fea-bfcf-6c17e18db3c0 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61f561e270a4b658506d0a22f562dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '350b2ff78dac4a14a12b78bb343d4195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:27:26.202437 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-e3a32a44-0595-4fea-bfcf-6c17e18db3c0 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30" status: 200 len: 1309 microversion: 2.1 time: 0.089509 Oct 12 04:27:26.203028 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 543/1072] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:27:26 2021] GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30 => generated 1309 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:27:27.220090 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-83949134-c8be-4de6-b8bc-ad8ba2656c65 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:27:27.220782 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-83949134-c8be-4de6-b8bc-ad8ba2656c65 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] [instance: cdcd70e1-7313-4f25-b52d-237f8de47c30] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:27:27.226734 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-83949134-c8be-4de6-b8bc-ad8ba2656c65 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:27:27.227181 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-83949134-c8be-4de6-b8bc-ad8ba2656c65 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:27:27.228194 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-83949134-c8be-4de6-b8bc-ad8ba2656c65 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:27:27.228621 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-83949134-c8be-4de6-b8bc-ad8ba2656c65 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:27:27.241569 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.wsgi [None req-83949134-c8be-4de6-b8bc-ad8ba2656c65 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] HTTP exception thrown: Instance cdcd70e1-7313-4f25-b52d-237f8de47c30 could not be found. Oct 12 04:27:27.242135 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-83949134-c8be-4de6-b8bc-ad8ba2656c65 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] Returning 404 to user: Instance cdcd70e1-7313-4f25-b52d-237f8de47c30 could not be found. {{(pid=108898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:27:27.242952 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-83949134-c8be-4de6-b8bc-ad8ba2656c65 tempest-VolumesSnapshotTestJSON-145756773 tempest-VolumesSnapshotTestJSON-145756773-project] 10.222.0.21 "GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30" status: 404 len: 111 microversion: 2.1 time: 0.026853 Oct 12 04:27:27.243470 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 530/1073] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:27:27 2021] GET /compute/v2.1/servers/cdcd70e1-7313-4f25-b52d-237f8de47c30 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:28:06.084152 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-4632bdf4-b6e4-4e32-81c7-21a07e4e27db tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Action: 'create', calling method: .version_select at 0x7f3855541160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2143205246"}} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:28:06.106771 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-4632bdf4-b6e4-4e32-81c7-21a07e4e27db tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Getting quotas for project 07dacc449ddf4eacbce081796b99d647. Resources: {'key_pairs'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:28:06.110858 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-4632bdf4-b6e4-4e32-81c7-21a07e4e27db tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Getting quotas for user 93aa7a5e0a074530ae9595e9debaf8aa and project 07dacc449ddf4eacbce081796b99d647. Resources: {'key_pairs'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:28:06.470453 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-4632bdf4-b6e4-4e32-81c7-21a07e4e27db tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Getting quotas for project 07dacc449ddf4eacbce081796b99d647. Resources: {'key_pairs'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:28:06.474433 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.quota [None req-4632bdf4-b6e4-4e32-81c7-21a07e4e27db tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Getting quotas for user 93aa7a5e0a074530ae9595e9debaf8aa and project 07dacc449ddf4eacbce081796b99d647. Resources: {'key_pairs'} {{(pid=108897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:28:06.488902 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-4632bdf4-b6e4-4e32-81c7-21a07e4e27db tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.591882 Oct 12 04:28:06.489537 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 544/1074] 10.222.0.21 () {60 vars in 1157 bytes} [Tue Oct 12 04:28:05 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:28:25.232778 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-4c437d1c-6d4b-425d-9326-33cde8e4bba7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1948953729", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2143205246", "security_groups": [{"name": "tempest-secgroup-smoke-649699211"}], "block_device_mapping_v2": [{"uuid": "e9296656-3618-479e-85a4-9068d8258db2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ec34bde3-5025-40d5-9384-8e9eb1870b7b"}]}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:28:25.326725 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.network.neutron [None req-4c437d1c-6d4b-425d-9326-33cde8e4bba7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] validate_networks() for [('ec34bde3-5025-40d5-9384-8e9eb1870b7b', None, None, None, None, None)] {{(pid=108898) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 04:28:25.778780 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-4c437d1c-6d4b-425d-9326-33cde8e4bba7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Flavor limits 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 04:28:25.779198 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-4c437d1c-6d4b-425d-9326-33cde8e4bba7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Image limits 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 04:28:25.779683 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-4c437d1c-6d4b-425d-9326-33cde8e4bba7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Flavor pref 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 04:28:25.780083 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-4c437d1c-6d4b-425d-9326-33cde8e4bba7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Image pref 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 04:28:25.780480 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-4c437d1c-6d4b-425d-9326-33cde8e4bba7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 04:28:25.788735 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4c437d1c-6d4b-425d-9326-33cde8e4bba7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:25.789170 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4c437d1c-6d4b-425d-9326-33cde8e4bba7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:25.789949 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4c437d1c-6d4b-425d-9326-33cde8e4bba7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:25.790369 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4c437d1c-6d4b-425d-9326-33cde8e4bba7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:25.805724 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-4c437d1c-6d4b-425d-9326-33cde8e4bba7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Getting quotas for project 07dacc449ddf4eacbce081796b99d647. Resources: {'cores', 'instances', 'ram'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:28:25.809976 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-4c437d1c-6d4b-425d-9326-33cde8e4bba7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Getting quotas for user 93aa7a5e0a074530ae9595e9debaf8aa and project 07dacc449ddf4eacbce081796b99d647. Resources: {'cores', 'instances', 'ram'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:28:25.862181 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-4c437d1c-6d4b-425d-9326-33cde8e4bba7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Going to run 1 instances... {{(pid=108898) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 04:28:25.864329 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-4c437d1c-6d4b-425d-9326-33cde8e4bba7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e9296656-3618-479e-85a4-9068d8258db2',volume_size=None,volume_type=None)] {{(pid=108898) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 04:28:26.309134 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-4c437d1c-6d4b-425d-9326-33cde8e4bba7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.080903 Oct 12 04:28:26.310436 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 531/1075] 10.222.0.21 () {60 vars in 1146 bytes} [Tue Oct 12 04:28:25 2021] POST /compute/v2.1/servers => generated 405 bytes in 1083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 04:28:26.319959 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-9e2e532e-64e4-4f3d-8a35-33b4317cab75 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:28:26.323274 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-9e2e532e-64e4-4f3d-8a35-33b4317cab75 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:28:26.372467 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-9e2e532e-64e4-4f3d-8a35-33b4317cab75 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:28:26.379366 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-9e2e532e-64e4-4f3d-8a35-33b4317cab75 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2" status: 200 len: 1095 microversion: 2.1 time: 0.063107 Oct 12 04:28:26.379908 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 545/1076] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:28:26 2021] GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2 => generated 1095 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:28:27.395987 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-0d96af0f-e821-4266-a52f-dddb07a21b82 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:28:27.396596 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-0d96af0f-e821-4266-a52f-dddb07a21b82 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:28:27.446950 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-0d96af0f-e821-4266-a52f-dddb07a21b82 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:28:27.453895 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-0d96af0f-e821-4266-a52f-dddb07a21b82 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2" status: 200 len: 1095 microversion: 2.1 time: 0.061563 Oct 12 04:28:27.454441 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 532/1077] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:28:27 2021] GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2 => generated 1095 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:28:28.471421 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-cc86a78b-4f6f-400f-b8af-2db84a183f9c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:28:28.471967 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-cc86a78b-4f6f-400f-b8af-2db84a183f9c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:28:28.522129 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-cc86a78b-4f6f-400f-b8af-2db84a183f9c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:28:28.529328 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-cc86a78b-4f6f-400f-b8af-2db84a183f9c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2" status: 200 len: 1095 microversion: 2.1 time: 0.062553 Oct 12 04:28:28.529879 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 546/1078] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:28:28 2021] GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2 => generated 1095 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:28:29.546422 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-705418fb-a6c9-4471-af88-da08e27135d3 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:28:29.547058 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-705418fb-a6c9-4471-af88-da08e27135d3 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:28:29.549451 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0cef7165-6256-471b-b282-b35f994dd139] AMQP server on 10.222.0.21:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 04:28:29.553838 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-705418fb-a6c9-4471-af88-da08e27135d3 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:29.554280 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-705418fb-a6c9-4471-af88-da08e27135d3 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:29.555139 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-705418fb-a6c9-4471-af88-da08e27135d3 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:29.555568 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-705418fb-a6c9-4471-af88-da08e27135d3 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:29.612526 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-705418fb-a6c9-4471-af88-da08e27135d3 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:28:29.619646 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-705418fb-a6c9-4471-af88-da08e27135d3 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2" status: 200 len: 1145 microversion: 2.1 time: 0.077462 Oct 12 04:28:29.620197 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 533/1079] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:28:29 2021] GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2 => generated 1145 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:28:30.636286 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-26ef1757-63a4-4e91-9e9d-502de53c6bac tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:28:30.637007 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-26ef1757-63a4-4e91-9e9d-502de53c6bac tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:28:30.644605 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-26ef1757-63a4-4e91-9e9d-502de53c6bac tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:30.648626 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-26ef1757-63a4-4e91-9e9d-502de53c6bac tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:30.648626 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-26ef1757-63a4-4e91-9e9d-502de53c6bac tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:30.648626 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-26ef1757-63a4-4e91-9e9d-502de53c6bac tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:30.901647 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-26ef1757-63a4-4e91-9e9d-502de53c6bac tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:28:30.908942 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-26ef1757-63a4-4e91-9e9d-502de53c6bac tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2" status: 200 len: 1201 microversion: 2.1 time: 0.276330 Oct 12 04:28:30.909504 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 547/1080] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:28:30 2021] GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2 => generated 1201 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:28:31.930388 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-6f85d386-d755-409f-8a17-6907151ce85b tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:28:31.931140 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-6f85d386-d755-409f-8a17-6907151ce85b tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:28:31.948469 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6f85d386-d755-409f-8a17-6907151ce85b tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:31.948917 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6f85d386-d755-409f-8a17-6907151ce85b tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:31.949681 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6f85d386-d755-409f-8a17-6907151ce85b tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:31.950692 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6f85d386-d755-409f-8a17-6907151ce85b tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:31.957339 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO oslo.messaging._drivers.impl_rabbit [-] [0cef7165-6256-471b-b282-b35f994dd139] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 38766. Oct 12 04:28:32.077054 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-6f85d386-d755-409f-8a17-6907151ce85b tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:28:32.084216 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-6f85d386-d755-409f-8a17-6907151ce85b tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2" status: 200 len: 1266 microversion: 2.1 time: 0.157494 Oct 12 04:28:32.084772 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 534/1081] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:28:31 2021] GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:28:32.409414 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-f267a72d-49c1-4076-81ad-37465b75861c req-d6f8fdfd-e207-44a5-82ce-689155efc485 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ca30d68-1c68-4f1f-8edb-690294e9a5f2", "tag": "1ef71a4d-3c49-48b3-8dfc-8e1d2ff62eaf"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:28:32.410949 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:28:32.410949 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:28:32.421312 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-f267a72d-49c1-4076-81ad-37465b75861c req-d6f8fdfd-e207-44a5-82ce-689155efc485 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:32.422050 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-f267a72d-49c1-4076-81ad-37465b75861c req-d6f8fdfd-e207-44a5-82ce-689155efc485 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:32.433466 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-f267a72d-49c1-4076-81ad-37465b75861c req-d6f8fdfd-e207-44a5-82ce-689155efc485 service nova] Creating event network-changed:1ef71a4d-3c49-48b3-8dfc-8e1d2ff62eaf for instance 7ca30d68-1c68-4f1f-8edb-690294e9a5f2 on hv-cinder-81306 Oct 12 04:28:32.441249 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-f267a72d-49c1-4076-81ad-37465b75861c req-d6f8fdfd-e207-44a5-82ce-689155efc485 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035807 Oct 12 04:28:32.441792 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 548/1082] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:28:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:28:33.101118 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-b562213f-cd83-408f-8e05-c479f95a5745 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:28:33.102633 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-b562213f-cd83-408f-8e05-c479f95a5745 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:28:33.108595 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b562213f-cd83-408f-8e05-c479f95a5745 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:33.109035 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b562213f-cd83-408f-8e05-c479f95a5745 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:33.109801 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b562213f-cd83-408f-8e05-c479f95a5745 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:33.110225 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b562213f-cd83-408f-8e05-c479f95a5745 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:33.238942 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-b562213f-cd83-408f-8e05-c479f95a5745 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:28:33.246412 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-b562213f-cd83-408f-8e05-c479f95a5745 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2" status: 200 len: 1266 microversion: 2.1 time: 0.148944 Oct 12 04:28:33.247529 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 535/1083] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:28:33 2021] GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:28:33.319627 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 04:28:33.319872 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: Tue Oct 12 04:28:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 12 04:28:34.264007 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-271d8c0d-e57e-4929-a28b-f03a6b781f4b tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:28:34.264729 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-271d8c0d-e57e-4929-a28b-f03a6b781f4b tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:28:34.270815 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-271d8c0d-e57e-4929-a28b-f03a6b781f4b tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:34.271269 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-271d8c0d-e57e-4929-a28b-f03a6b781f4b tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:34.272035 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-271d8c0d-e57e-4929-a28b-f03a6b781f4b tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:34.272471 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-271d8c0d-e57e-4929-a28b-f03a6b781f4b tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:34.393738 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-271d8c0d-e57e-4929-a28b-f03a6b781f4b tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:28:34.400849 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-271d8c0d-e57e-4929-a28b-f03a6b781f4b tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2" status: 200 len: 1266 microversion: 2.1 time: 0.141393 Oct 12 04:28:34.401399 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 549/1084] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:28:34 2021] GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:28:35.417121 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-ffd0ad7f-5401-42fb-b51d-f855cf4a5a70 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:28:35.417725 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-ffd0ad7f-5401-42fb-b51d-f855cf4a5a70 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:28:35.423747 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ffd0ad7f-5401-42fb-b51d-f855cf4a5a70 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:35.424191 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ffd0ad7f-5401-42fb-b51d-f855cf4a5a70 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:35.424956 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ffd0ad7f-5401-42fb-b51d-f855cf4a5a70 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:35.425384 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ffd0ad7f-5401-42fb-b51d-f855cf4a5a70 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:35.541987 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-ffd0ad7f-5401-42fb-b51d-f855cf4a5a70 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:28:35.549047 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-ffd0ad7f-5401-42fb-b51d-f855cf4a5a70 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2" status: 200 len: 1266 microversion: 2.1 time: 0.135643 Oct 12 04:28:35.549599 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 536/1085] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:28:35 2021] GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2 => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:28:36.565436 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-919e80d6-14e9-4a58-8225-664ac22562d0 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:28:36.566044 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-919e80d6-14e9-4a58-8225-664ac22562d0 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:28:36.571813 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-919e80d6-14e9-4a58-8225-664ac22562d0 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:36.572250 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-919e80d6-14e9-4a58-8225-664ac22562d0 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:36.572997 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-919e80d6-14e9-4a58-8225-664ac22562d0 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:36.573419 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-919e80d6-14e9-4a58-8225-664ac22562d0 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:36.689134 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-919e80d6-14e9-4a58-8225-664ac22562d0 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:28:36.696132 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-919e80d6-14e9-4a58-8225-664ac22562d0 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2" status: 200 len: 1266 microversion: 2.1 time: 0.134405 Oct 12 04:28:36.696670 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 550/1086] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:28:36 2021] GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2 => generated 1266 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:28:37.713203 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-97631831-b54d-4948-9530-3598b9815a1a tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:28:37.713812 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-97631831-b54d-4948-9530-3598b9815a1a tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:28:37.720199 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-97631831-b54d-4948-9530-3598b9815a1a tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:37.720645 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-97631831-b54d-4948-9530-3598b9815a1a tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:37.721403 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-97631831-b54d-4948-9530-3598b9815a1a tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:37.721834 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-97631831-b54d-4948-9530-3598b9815a1a tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:37.843674 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-97631831-b54d-4948-9530-3598b9815a1a tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:28:37.850805 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-97631831-b54d-4948-9530-3598b9815a1a tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2" status: 200 len: 1266 microversion: 2.1 time: 0.141209 Oct 12 04:28:37.851357 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 537/1087] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:28:37 2021] GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:28:38.868646 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-562627cf-e545-424d-bd8c-bfd3f2a78106 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:28:38.869178 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-562627cf-e545-424d-bd8c-bfd3f2a78106 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:28:38.875766 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-562627cf-e545-424d-bd8c-bfd3f2a78106 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:38.876202 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-562627cf-e545-424d-bd8c-bfd3f2a78106 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:38.876950 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-562627cf-e545-424d-bd8c-bfd3f2a78106 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:38.877393 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-562627cf-e545-424d-bd8c-bfd3f2a78106 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:39.004119 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-562627cf-e545-424d-bd8c-bfd3f2a78106 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:28:39.011319 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-562627cf-e545-424d-bd8c-bfd3f2a78106 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2" status: 200 len: 1266 microversion: 2.1 time: 0.146719 Oct 12 04:28:39.011860 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 551/1088] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:28:38 2021] GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:28:40.027869 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d37b0d7e-ec2d-45fc-9947-47f6f5593fcd tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:28:40.028403 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-d37b0d7e-ec2d-45fc-9947-47f6f5593fcd tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:28:40.034058 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d37b0d7e-ec2d-45fc-9947-47f6f5593fcd tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:40.034499 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d37b0d7e-ec2d-45fc-9947-47f6f5593fcd tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:40.035278 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d37b0d7e-ec2d-45fc-9947-47f6f5593fcd tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:40.035706 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d37b0d7e-ec2d-45fc-9947-47f6f5593fcd tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:40.154364 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-d37b0d7e-ec2d-45fc-9947-47f6f5593fcd tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:28:40.165221 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-d37b0d7e-ec2d-45fc-9947-47f6f5593fcd tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2" status: 200 len: 1266 microversion: 2.1 time: 0.140944 Oct 12 04:28:40.165785 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 538/1089] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:28:40 2021] GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:28:41.185462 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-32c80ee4-a48e-4c0d-9a48-2794aaa7fafd tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:28:41.186100 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-32c80ee4-a48e-4c0d-9a48-2794aaa7fafd tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:28:41.192895 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-32c80ee4-a48e-4c0d-9a48-2794aaa7fafd tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:41.193340 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-32c80ee4-a48e-4c0d-9a48-2794aaa7fafd tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:41.194094 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-32c80ee4-a48e-4c0d-9a48-2794aaa7fafd tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:41.194525 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-32c80ee4-a48e-4c0d-9a48-2794aaa7fafd tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:41.313870 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-32c80ee4-a48e-4c0d-9a48-2794aaa7fafd tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:28:41.320904 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-32c80ee4-a48e-4c0d-9a48-2794aaa7fafd tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2" status: 200 len: 1266 microversion: 2.1 time: 0.141069 Oct 12 04:28:41.321478 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 552/1090] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:28:41 2021] GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:28:42.337226 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-7a413d94-fea2-4ac8-91d3-392e0828b2b2 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:28:42.337846 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-7a413d94-fea2-4ac8-91d3-392e0828b2b2 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:28:42.343761 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7a413d94-fea2-4ac8-91d3-392e0828b2b2 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:42.344210 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7a413d94-fea2-4ac8-91d3-392e0828b2b2 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:42.344972 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7a413d94-fea2-4ac8-91d3-392e0828b2b2 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:42.345410 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7a413d94-fea2-4ac8-91d3-392e0828b2b2 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:42.468932 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-7a413d94-fea2-4ac8-91d3-392e0828b2b2 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:28:42.477260 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-7a413d94-fea2-4ac8-91d3-392e0828b2b2 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2" status: 200 len: 1266 microversion: 2.1 time: 0.143673 Oct 12 04:28:42.477808 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 539/1091] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:28:42 2021] GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2 => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:28:43.217555 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-aaf364d1-61e2-43cd-8ab3-f31b5e2a2fd8 req-276aeb3c-25c6-442e-a779-05a37bdf91fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ca30d68-1c68-4f1f-8edb-690294e9a5f2", "name": "network-vif-plugged", "status": "completed", "tag": "1ef71a4d-3c49-48b3-8dfc-8e1d2ff62eaf"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:28:43.219644 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:28:43.219644 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:28:43.226222 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-aaf364d1-61e2-43cd-8ab3-f31b5e2a2fd8 req-276aeb3c-25c6-442e-a779-05a37bdf91fa service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:43.227544 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-aaf364d1-61e2-43cd-8ab3-f31b5e2a2fd8 req-276aeb3c-25c6-442e-a779-05a37bdf91fa service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:43.237620 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-aaf364d1-61e2-43cd-8ab3-f31b5e2a2fd8 req-276aeb3c-25c6-442e-a779-05a37bdf91fa service nova] Creating event network-vif-plugged:1ef71a4d-3c49-48b3-8dfc-8e1d2ff62eaf for instance 7ca30d68-1c68-4f1f-8edb-690294e9a5f2 on hv-cinder-81306 Oct 12 04:28:43.242593 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-aaf364d1-61e2-43cd-8ab3-f31b5e2a2fd8 req-276aeb3c-25c6-442e-a779-05a37bdf91fa service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082595 Oct 12 04:28:43.243186 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 553/1092] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:28:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:28:43.509885 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-8a28c4e5-584b-449e-8ea2-85bd3d4a45ef tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:28:43.510499 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-8a28c4e5-584b-449e-8ea2-85bd3d4a45ef tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:28:43.517198 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8a28c4e5-584b-449e-8ea2-85bd3d4a45ef tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:43.518274 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8a28c4e5-584b-449e-8ea2-85bd3d4a45ef tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:43.518942 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8a28c4e5-584b-449e-8ea2-85bd3d4a45ef tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:43.519369 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8a28c4e5-584b-449e-8ea2-85bd3d4a45ef tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:43.672950 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-8a28c4e5-584b-449e-8ea2-85bd3d4a45ef tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:28:43.679945 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-8a28c4e5-584b-449e-8ea2-85bd3d4a45ef tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2" status: 200 len: 1266 microversion: 2.1 time: 0.174529 Oct 12 04:28:43.680492 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 540/1093] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:28:43 2021] GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:28:44.697457 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ddcbd081-cd95-4ea8-bd0b-09017fe10ccb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:28:44.698206 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ddcbd081-cd95-4ea8-bd0b-09017fe10ccb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:28:44.704160 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ddcbd081-cd95-4ea8-bd0b-09017fe10ccb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:44.704609 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ddcbd081-cd95-4ea8-bd0b-09017fe10ccb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:44.705371 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ddcbd081-cd95-4ea8-bd0b-09017fe10ccb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:44.705859 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ddcbd081-cd95-4ea8-bd0b-09017fe10ccb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:44.826406 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-ddcbd081-cd95-4ea8-bd0b-09017fe10ccb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:28:44.834180 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ddcbd081-cd95-4ea8-bd0b-09017fe10ccb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2" status: 200 len: 1266 microversion: 2.1 time: 0.140687 Oct 12 04:28:44.835051 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 554/1094] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:28:44 2021] GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:28:45.851649 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-ffe10285-6111-48f0-8c70-0bcd46ea2d8c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:28:45.852252 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-ffe10285-6111-48f0-8c70-0bcd46ea2d8c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:28:45.858010 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ffe10285-6111-48f0-8c70-0bcd46ea2d8c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:45.858990 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ffe10285-6111-48f0-8c70-0bcd46ea2d8c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:45.859742 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ffe10285-6111-48f0-8c70-0bcd46ea2d8c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:45.860163 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ffe10285-6111-48f0-8c70-0bcd46ea2d8c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:45.974890 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-ffe10285-6111-48f0-8c70-0bcd46ea2d8c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:28:45.982220 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-ffe10285-6111-48f0-8c70-0bcd46ea2d8c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2" status: 200 len: 1453 microversion: 2.1 time: 0.134485 Oct 12 04:28:45.982798 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 541/1095] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:28:45 2021] GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2 => generated 1453 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:28:45.998158 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ede7a409-6e08-48de-a911-8421d0502b77 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:28:45.998800 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ede7a409-6e08-48de-a911-8421d0502b77 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:28:46.004513 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ede7a409-6e08-48de-a911-8421d0502b77 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:46.004962 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ede7a409-6e08-48de-a911-8421d0502b77 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:46.005721 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ede7a409-6e08-48de-a911-8421d0502b77 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:46.006158 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ede7a409-6e08-48de-a911-8421d0502b77 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:46.131132 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-ede7a409-6e08-48de-a911-8421d0502b77 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:28:46.138260 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ede7a409-6e08-48de-a911-8421d0502b77 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2" status: 200 len: 1453 microversion: 2.1 time: 0.143722 Oct 12 04:28:46.138831 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 555/1096] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:28:45 2021] GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2 => generated 1453 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:28:48.098483 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-ef6165a7-5552-4290-99fd-523f203acfd9 req-702a40a1-8a73-4dfc-9771-50a8676dd467 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ca30d68-1c68-4f1f-8edb-690294e9a5f2", "tag": "1ef71a4d-3c49-48b3-8dfc-8e1d2ff62eaf"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:28:48.100098 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:28:48.100098 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:28:48.107057 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-ef6165a7-5552-4290-99fd-523f203acfd9 req-702a40a1-8a73-4dfc-9771-50a8676dd467 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:28:48.107494 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-ef6165a7-5552-4290-99fd-523f203acfd9 req-702a40a1-8a73-4dfc-9771-50a8676dd467 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:28:48.117955 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-ef6165a7-5552-4290-99fd-523f203acfd9 req-702a40a1-8a73-4dfc-9771-50a8676dd467 service nova] Creating event network-changed:1ef71a4d-3c49-48b3-8dfc-8e1d2ff62eaf for instance 7ca30d68-1c68-4f1f-8edb-690294e9a5f2 on hv-cinder-81306 Oct 12 04:28:48.123103 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-ef6165a7-5552-4290-99fd-523f203acfd9 req-702a40a1-8a73-4dfc-9771-50a8676dd467 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090467 Oct 12 04:28:48.123690 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 542/1097] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:28:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:30:43.092010 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c175fb9-c815-43ae-82fc-42b6c7387c8c] AMQP server on 10.222.0.21:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 04:30:43.095354 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-93a10bd9-7be1-4d37-86dd-491cc90d9eca tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:30:43.095850 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-93a10bd9-7be1-4d37-86dd-491cc90d9eca tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:30:43.101853 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-93a10bd9-7be1-4d37-86dd-491cc90d9eca tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:43.102296 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-93a10bd9-7be1-4d37-86dd-491cc90d9eca tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:43.103093 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-93a10bd9-7be1-4d37-86dd-491cc90d9eca tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:43.103526 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-93a10bd9-7be1-4d37-86dd-491cc90d9eca tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:43.128275 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-93a10bd9-7be1-4d37-86dd-491cc90d9eca tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] Going to try to terminate instance {{(pid=108897) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 04:30:43.435111 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-93a10bd9-7be1-4d37-86dd-491cc90d9eca tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "DELETE /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2" status: 204 len: 0 microversion: 2.1 time: 0.344779 Oct 12 04:30:43.435734 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 556/1098] 10.222.0.21 () {58 vars in 1238 bytes} [Tue Oct 12 04:30:43 2021] DELETE /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 04:30:43.444172 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0cef7165-6256-471b-b282-b35f994dd139] AMQP server on 10.222.0.21:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 12 04:30:43.448053 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-171f5209-acdc-4b51-bbaf-2e3f9cb14f3e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:30:43.448745 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-171f5209-acdc-4b51-bbaf-2e3f9cb14f3e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:30:43.454953 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-171f5209-acdc-4b51-bbaf-2e3f9cb14f3e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:43.455543 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-171f5209-acdc-4b51-bbaf-2e3f9cb14f3e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:43.456365 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-171f5209-acdc-4b51-bbaf-2e3f9cb14f3e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:43.456791 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-171f5209-acdc-4b51-bbaf-2e3f9cb14f3e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:43.580534 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-171f5209-acdc-4b51-bbaf-2e3f9cb14f3e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:30:43.587826 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-171f5209-acdc-4b51-bbaf-2e3f9cb14f3e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2" status: 200 len: 1578 microversion: 2.1 time: 0.147002 Oct 12 04:30:43.588379 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 543/1099] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:30:43 2021] GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2 => generated 1578 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:30:44.606858 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ae1f968d-e1d8-42fb-837f-f65ac6e831bd tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:30:44.607569 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ae1f968d-e1d8-42fb-837f-f65ac6e831bd tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:30:44.638907 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ae1f968d-e1d8-42fb-837f-f65ac6e831bd tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:44.639589 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ae1f968d-e1d8-42fb-837f-f65ac6e831bd tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:44.640766 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ae1f968d-e1d8-42fb-837f-f65ac6e831bd tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:44.641262 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ae1f968d-e1d8-42fb-837f-f65ac6e831bd tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:44.647871 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c175fb9-c815-43ae-82fc-42b6c7387c8c] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 38858. Oct 12 04:30:44.766444 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-ae1f968d-e1d8-42fb-837f-f65ac6e831bd tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:30:44.773622 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ae1f968d-e1d8-42fb-837f-f65ac6e831bd tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2" status: 200 len: 1578 microversion: 2.1 time: 0.170947 Oct 12 04:30:44.774166 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 557/1100] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:30:44 2021] GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2 => generated 1578 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:30:45.790845 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-7290a4dc-acd4-4c34-bb1b-17563aadbc9e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:30:45.791473 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-7290a4dc-acd4-4c34-bb1b-17563aadbc9e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:30:45.810204 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO oslo.messaging._drivers.impl_rabbit [-] [0cef7165-6256-471b-b282-b35f994dd139] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 38862. Oct 12 04:30:45.815621 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7290a4dc-acd4-4c34-bb1b-17563aadbc9e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:45.816064 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7290a4dc-acd4-4c34-bb1b-17563aadbc9e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:45.816846 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7290a4dc-acd4-4c34-bb1b-17563aadbc9e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:45.817272 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7290a4dc-acd4-4c34-bb1b-17563aadbc9e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:46.028913 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-7290a4dc-acd4-4c34-bb1b-17563aadbc9e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:30:46.037422 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-7290a4dc-acd4-4c34-bb1b-17563aadbc9e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2" status: 200 len: 1511 microversion: 2.1 time: 0.250366 Oct 12 04:30:46.037991 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 544/1101] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:30:45 2021] GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2 => generated 1511 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:30:46.212556 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-b52b723f-755a-460e-9ce9-d010641e4096 req-731b2f35-f9a5-427f-97b4-7f8eacdcba2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ca30d68-1c68-4f1f-8edb-690294e9a5f2", "name": "network-vif-deleted", "tag": "1ef71a4d-3c49-48b3-8dfc-8e1d2ff62eaf"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:30:46.221171 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:30:46.221171 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:30:46.221171 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-b52b723f-755a-460e-9ce9-d010641e4096 req-731b2f35-f9a5-427f-97b4-7f8eacdcba2c service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:46.221171 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-b52b723f-755a-460e-9ce9-d010641e4096 req-731b2f35-f9a5-427f-97b4-7f8eacdcba2c service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:46.231494 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-b52b723f-755a-460e-9ce9-d010641e4096 req-731b2f35-f9a5-427f-97b4-7f8eacdcba2c service nova] Creating event network-vif-deleted:1ef71a4d-3c49-48b3-8dfc-8e1d2ff62eaf for instance 7ca30d68-1c68-4f1f-8edb-690294e9a5f2 on hv-cinder-81306 Oct 12 04:30:46.237039 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-b52b723f-755a-460e-9ce9-d010641e4096 req-731b2f35-f9a5-427f-97b4-7f8eacdcba2c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028091 Oct 12 04:30:46.237600 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 558/1102] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:30:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:30:47.054189 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-1a2f7a7e-c136-407d-86f2-01db42c66f84 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:30:47.054815 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-1a2f7a7e-c136-407d-86f2-01db42c66f84 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:30:47.061734 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1a2f7a7e-c136-407d-86f2-01db42c66f84 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:47.062425 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1a2f7a7e-c136-407d-86f2-01db42c66f84 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:47.062976 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1a2f7a7e-c136-407d-86f2-01db42c66f84 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:47.063400 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1a2f7a7e-c136-407d-86f2-01db42c66f84 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:47.092878 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1a2f7a7e-c136-407d-86f2-01db42c66f84 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:47.093317 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1a2f7a7e-c136-407d-86f2-01db42c66f84 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:47.093752 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.objects.instance [None req-1a2f7a7e-c136-407d-86f2-01db42c66f84 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lazy-loading 'fault' on Instance uuid 7ca30d68-1c68-4f1f-8edb-690294e9a5f2 {{(pid=108898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 12 04:30:47.132588 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-1a2f7a7e-c136-407d-86f2-01db42c66f84 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:30:47.140159 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-1a2f7a7e-c136-407d-86f2-01db42c66f84 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2" status: 200 len: 1231 microversion: 2.1 time: 0.089619 Oct 12 04:30:47.140887 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 545/1103] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:30:47 2021] GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2 => generated 1231 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:30:48.157837 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-86387c24-fa06-4c8a-a5c7-be9af0133f7c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:30:48.159056 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-86387c24-fa06-4c8a-a5c7-be9af0133f7c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:30:48.165064 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-86387c24-fa06-4c8a-a5c7-be9af0133f7c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:48.165519 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-86387c24-fa06-4c8a-a5c7-be9af0133f7c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:48.166283 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-86387c24-fa06-4c8a-a5c7-be9af0133f7c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:48.166750 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-86387c24-fa06-4c8a-a5c7-be9af0133f7c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:48.179870 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.wsgi [None req-86387c24-fa06-4c8a-a5c7-be9af0133f7c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] HTTP exception thrown: Instance 7ca30d68-1c68-4f1f-8edb-690294e9a5f2 could not be found. Oct 12 04:30:48.180451 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-86387c24-fa06-4c8a-a5c7-be9af0133f7c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Returning 404 to user: Instance 7ca30d68-1c68-4f1f-8edb-690294e9a5f2 could not be found. {{(pid=108897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:30:48.181282 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-86387c24-fa06-4c8a-a5c7-be9af0133f7c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2" status: 404 len: 111 microversion: 2.1 time: 0.027470 Oct 12 04:30:48.181783 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 559/1104] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:30:48 2021] GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:30:48.227486 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-32c02b94-a651-46bc-ba14-ebc7bd89a2e8 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2101529476", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2143205246", "security_groups": [{"name": "tempest-secgroup-smoke-649699211"}], "block_device_mapping_v2": [{"uuid": "e9296656-3618-479e-85a4-9068d8258db2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ec34bde3-5025-40d5-9384-8e9eb1870b7b"}]}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:30:48.324459 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.network.neutron [None req-32c02b94-a651-46bc-ba14-ebc7bd89a2e8 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] validate_networks() for [('ec34bde3-5025-40d5-9384-8e9eb1870b7b', None, None, None, None, None)] {{(pid=108898) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 04:30:48.685741 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-32c02b94-a651-46bc-ba14-ebc7bd89a2e8 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Flavor limits 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 04:30:48.686151 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-32c02b94-a651-46bc-ba14-ebc7bd89a2e8 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Image limits 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 04:30:48.686612 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-32c02b94-a651-46bc-ba14-ebc7bd89a2e8 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Flavor pref 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 04:30:48.687044 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-32c02b94-a651-46bc-ba14-ebc7bd89a2e8 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Image pref 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 04:30:48.687471 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-32c02b94-a651-46bc-ba14-ebc7bd89a2e8 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 04:30:48.701712 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-32c02b94-a651-46bc-ba14-ebc7bd89a2e8 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:48.702155 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-32c02b94-a651-46bc-ba14-ebc7bd89a2e8 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:48.702990 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-32c02b94-a651-46bc-ba14-ebc7bd89a2e8 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:48.703419 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-32c02b94-a651-46bc-ba14-ebc7bd89a2e8 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:48.720379 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-32c02b94-a651-46bc-ba14-ebc7bd89a2e8 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Getting quotas for project 07dacc449ddf4eacbce081796b99d647. Resources: {'cores', 'instances', 'ram'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:30:48.725131 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-32c02b94-a651-46bc-ba14-ebc7bd89a2e8 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Getting quotas for user 93aa7a5e0a074530ae9595e9debaf8aa and project 07dacc449ddf4eacbce081796b99d647. Resources: {'cores', 'instances', 'ram'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:30:48.778733 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-32c02b94-a651-46bc-ba14-ebc7bd89a2e8 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Going to run 1 instances... {{(pid=108898) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 04:30:48.781279 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-32c02b94-a651-46bc-ba14-ebc7bd89a2e8 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: fd5b9a34-32a4-436a-9aa6-89a7cae198a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e9296656-3618-479e-85a4-9068d8258db2',volume_size=None,volume_type=None)] {{(pid=108898) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 04:30:49.198406 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-32c02b94-a651-46bc-ba14-ebc7bd89a2e8 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.974615 Oct 12 04:30:49.199064 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 546/1105] 10.222.0.21 () {60 vars in 1146 bytes} [Tue Oct 12 04:30:48 2021] POST /compute/v2.1/servers => generated 405 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 04:30:49.208713 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ada53578-9ef7-403d-9d01-a8f07182a772 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:30:49.209355 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ada53578-9ef7-403d-9d01-a8f07182a772 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: fd5b9a34-32a4-436a-9aa6-89a7cae198a8] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:30:49.261504 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-ada53578-9ef7-403d-9d01-a8f07182a772 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:30:49.267979 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ada53578-9ef7-403d-9d01-a8f07182a772 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8" status: 200 len: 1095 microversion: 2.1 time: 0.062981 Oct 12 04:30:49.268521 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 560/1106] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:30:49 2021] GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8 => generated 1095 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:30:50.285461 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-7dfba4d1-38e8-4efa-9508-62408265c98f tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:30:50.286001 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-7dfba4d1-38e8-4efa-9508-62408265c98f tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: fd5b9a34-32a4-436a-9aa6-89a7cae198a8] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:30:50.291843 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7dfba4d1-38e8-4efa-9508-62408265c98f tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:50.292291 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7dfba4d1-38e8-4efa-9508-62408265c98f tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:50.293055 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7dfba4d1-38e8-4efa-9508-62408265c98f tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:50.293487 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-7dfba4d1-38e8-4efa-9508-62408265c98f tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:50.351223 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-7dfba4d1-38e8-4efa-9508-62408265c98f tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:30:50.358435 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-7dfba4d1-38e8-4efa-9508-62408265c98f tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8" status: 200 len: 1137 microversion: 2.1 time: 0.077347 Oct 12 04:30:50.359017 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 547/1107] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:30:50 2021] GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8 => generated 1137 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:30:51.375454 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-30e6a650-bedb-4864-8a1f-accb871535fb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:30:51.376069 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-30e6a650-bedb-4864-8a1f-accb871535fb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: fd5b9a34-32a4-436a-9aa6-89a7cae198a8] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:30:51.382495 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-30e6a650-bedb-4864-8a1f-accb871535fb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:51.387117 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-30e6a650-bedb-4864-8a1f-accb871535fb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:51.387117 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-30e6a650-bedb-4864-8a1f-accb871535fb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:51.387117 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-30e6a650-bedb-4864-8a1f-accb871535fb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:51.451861 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-30e6a650-bedb-4864-8a1f-accb871535fb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:30:51.459237 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-30e6a650-bedb-4864-8a1f-accb871535fb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8" status: 200 len: 1211 microversion: 2.1 time: 0.087458 Oct 12 04:30:51.460078 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 561/1108] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:30:51 2021] GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8 => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:30:52.476881 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-b76f2fbb-c2de-4ce4-ae51-2a7acd86eb61 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:30:52.477481 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-b76f2fbb-c2de-4ce4-ae51-2a7acd86eb61 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: fd5b9a34-32a4-436a-9aa6-89a7cae198a8] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:30:52.483815 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b76f2fbb-c2de-4ce4-ae51-2a7acd86eb61 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:52.484420 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b76f2fbb-c2de-4ce4-ae51-2a7acd86eb61 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:52.485383 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b76f2fbb-c2de-4ce4-ae51-2a7acd86eb61 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:52.486478 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-b76f2fbb-c2de-4ce4-ae51-2a7acd86eb61 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:52.506044 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-d2836d98-3b07-49a7-a610-d17586101e97 req-3cf66575-13fd-489e-9660-2dd4a9052809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd5b9a34-32a4-436a-9aa6-89a7cae198a8", "tag": "3436ba7c-4372-4060-9d7d-55c76a050c80"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:30:52.508594 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:30:52.508594 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:30:52.516218 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-d2836d98-3b07-49a7-a610-d17586101e97 req-3cf66575-13fd-489e-9660-2dd4a9052809 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:52.516934 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-d2836d98-3b07-49a7-a610-d17586101e97 req-3cf66575-13fd-489e-9660-2dd4a9052809 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:52.536986 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-d2836d98-3b07-49a7-a610-d17586101e97 req-3cf66575-13fd-489e-9660-2dd4a9052809 service nova] Creating event network-changed:3436ba7c-4372-4060-9d7d-55c76a050c80 for instance fd5b9a34-32a4-436a-9aa6-89a7cae198a8 on hv-cinder-81306 Oct 12 04:30:52.542343 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-d2836d98-3b07-49a7-a610-d17586101e97 req-3cf66575-13fd-489e-9660-2dd4a9052809 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040907 Oct 12 04:30:52.542863 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 562/1109] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:30:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:30:52.653714 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-b76f2fbb-c2de-4ce4-ae51-2a7acd86eb61 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:30:52.661309 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-b76f2fbb-c2de-4ce4-ae51-2a7acd86eb61 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8" status: 200 len: 1266 microversion: 2.1 time: 0.188274 Oct 12 04:30:52.662125 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 548/1110] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:30:52 2021] GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:30:53.679128 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-8f8235ab-dd9e-4711-a8ef-b9be1ae8eb1c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:30:53.679821 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-8f8235ab-dd9e-4711-a8ef-b9be1ae8eb1c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: fd5b9a34-32a4-436a-9aa6-89a7cae198a8] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:30:53.685845 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8f8235ab-dd9e-4711-a8ef-b9be1ae8eb1c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:53.686298 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8f8235ab-dd9e-4711-a8ef-b9be1ae8eb1c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:53.687095 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8f8235ab-dd9e-4711-a8ef-b9be1ae8eb1c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:53.687532 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-8f8235ab-dd9e-4711-a8ef-b9be1ae8eb1c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:53.807385 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-8f8235ab-dd9e-4711-a8ef-b9be1ae8eb1c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:30:53.814627 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-8f8235ab-dd9e-4711-a8ef-b9be1ae8eb1c tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8" status: 200 len: 1266 microversion: 2.1 time: 0.139448 Oct 12 04:30:53.815203 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 563/1111] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:30:53 2021] GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:30:54.831168 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-6d4447a7-33aa-4551-8e00-e7475bd38ca7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:30:54.831768 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-6d4447a7-33aa-4551-8e00-e7475bd38ca7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: fd5b9a34-32a4-436a-9aa6-89a7cae198a8] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:30:54.837729 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6d4447a7-33aa-4551-8e00-e7475bd38ca7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:54.838179 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6d4447a7-33aa-4551-8e00-e7475bd38ca7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:54.838982 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6d4447a7-33aa-4551-8e00-e7475bd38ca7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:54.839434 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6d4447a7-33aa-4551-8e00-e7475bd38ca7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:54.954780 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-6d4447a7-33aa-4551-8e00-e7475bd38ca7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:30:54.961951 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-6d4447a7-33aa-4551-8e00-e7475bd38ca7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8" status: 200 len: 1266 microversion: 2.1 time: 0.134368 Oct 12 04:30:54.962537 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 549/1112] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:30:54 2021] GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8 => generated 1266 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:30:55.978356 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-769bd89a-4c4f-4ab3-892a-811fa9a22b6e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:30:55.978989 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-769bd89a-4c4f-4ab3-892a-811fa9a22b6e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: fd5b9a34-32a4-436a-9aa6-89a7cae198a8] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:30:55.984877 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-769bd89a-4c4f-4ab3-892a-811fa9a22b6e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:55.985322 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-769bd89a-4c4f-4ab3-892a-811fa9a22b6e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:55.986564 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-769bd89a-4c4f-4ab3-892a-811fa9a22b6e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:55.987084 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-769bd89a-4c4f-4ab3-892a-811fa9a22b6e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:56.108761 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-769bd89a-4c4f-4ab3-892a-811fa9a22b6e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:30:56.115264 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-769bd89a-4c4f-4ab3-892a-811fa9a22b6e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8" status: 200 len: 1266 microversion: 2.1 time: 0.140766 Oct 12 04:30:56.115813 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 564/1113] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:30:55 2021] GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:30:57.131507 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-5f4aac4a-c7f3-47c5-bce6-0856808b7dae tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:30:57.132111 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-5f4aac4a-c7f3-47c5-bce6-0856808b7dae tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: fd5b9a34-32a4-436a-9aa6-89a7cae198a8] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:30:57.137852 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5f4aac4a-c7f3-47c5-bce6-0856808b7dae tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:57.138299 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5f4aac4a-c7f3-47c5-bce6-0856808b7dae tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:57.139156 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5f4aac4a-c7f3-47c5-bce6-0856808b7dae tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:57.139584 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-5f4aac4a-c7f3-47c5-bce6-0856808b7dae tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:57.259966 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-5f4aac4a-c7f3-47c5-bce6-0856808b7dae tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:30:57.267071 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-5f4aac4a-c7f3-47c5-bce6-0856808b7dae tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8" status: 200 len: 1266 microversion: 2.1 time: 0.139190 Oct 12 04:30:57.268285 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 550/1114] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:30:57 2021] GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:30:58.284723 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ca398914-682a-40c9-8957-328415386840 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:30:58.285328 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ca398914-682a-40c9-8957-328415386840 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: fd5b9a34-32a4-436a-9aa6-89a7cae198a8] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:30:58.291059 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ca398914-682a-40c9-8957-328415386840 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:58.291505 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ca398914-682a-40c9-8957-328415386840 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:58.292261 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ca398914-682a-40c9-8957-328415386840 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:58.292691 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ca398914-682a-40c9-8957-328415386840 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:58.414325 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-ca398914-682a-40c9-8957-328415386840 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:30:58.421471 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ca398914-682a-40c9-8957-328415386840 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8" status: 200 len: 1266 microversion: 2.1 time: 0.141045 Oct 12 04:30:58.422027 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 565/1115] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:30:58 2021] GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:30:59.438159 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-82cacdf5-fd38-42f2-9549-5a45e946b87d tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:30:59.438788 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-82cacdf5-fd38-42f2-9549-5a45e946b87d tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: fd5b9a34-32a4-436a-9aa6-89a7cae198a8] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:30:59.445108 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-82cacdf5-fd38-42f2-9549-5a45e946b87d tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:59.445549 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-82cacdf5-fd38-42f2-9549-5a45e946b87d tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:59.446312 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-82cacdf5-fd38-42f2-9549-5a45e946b87d tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:30:59.446775 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-82cacdf5-fd38-42f2-9549-5a45e946b87d tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:30:59.567015 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-82cacdf5-fd38-42f2-9549-5a45e946b87d tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:30:59.574319 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-82cacdf5-fd38-42f2-9549-5a45e946b87d tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8" status: 200 len: 1266 microversion: 2.1 time: 0.139839 Oct 12 04:30:59.574908 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 551/1116] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:30:59 2021] GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:31:00.591421 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-efb630f2-c37a-4cbb-b7bf-83da973dc9c9 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:31:00.592020 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-efb630f2-c37a-4cbb-b7bf-83da973dc9c9 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: fd5b9a34-32a4-436a-9aa6-89a7cae198a8] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:31:00.598381 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-efb630f2-c37a-4cbb-b7bf-83da973dc9c9 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:31:00.598866 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-efb630f2-c37a-4cbb-b7bf-83da973dc9c9 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:31:00.599879 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-efb630f2-c37a-4cbb-b7bf-83da973dc9c9 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:31:00.600359 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-efb630f2-c37a-4cbb-b7bf-83da973dc9c9 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:31:00.725870 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-efb630f2-c37a-4cbb-b7bf-83da973dc9c9 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:31:00.732969 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-efb630f2-c37a-4cbb-b7bf-83da973dc9c9 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8" status: 200 len: 1266 microversion: 2.1 time: 0.145197 Oct 12 04:31:00.733518 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 566/1117] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:31:00 2021] GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:31:01.748988 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-54cf9d2d-61b1-4f7a-ae2f-707098a0bece tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:31:01.749586 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-54cf9d2d-61b1-4f7a-ae2f-707098a0bece tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: fd5b9a34-32a4-436a-9aa6-89a7cae198a8] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:31:01.755312 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-54cf9d2d-61b1-4f7a-ae2f-707098a0bece tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:31:01.757711 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-54cf9d2d-61b1-4f7a-ae2f-707098a0bece tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:31:01.757711 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-54cf9d2d-61b1-4f7a-ae2f-707098a0bece tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:31:01.757711 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-54cf9d2d-61b1-4f7a-ae2f-707098a0bece tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:31:01.876268 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-54cf9d2d-61b1-4f7a-ae2f-707098a0bece tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:31:01.883533 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-54cf9d2d-61b1-4f7a-ae2f-707098a0bece tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8" status: 200 len: 1266 microversion: 2.1 time: 0.138191 Oct 12 04:31:01.884106 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 552/1118] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:31:01 2021] GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:31:02.900021 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-55adc537-ac03-4551-8f5e-cb69d3b9eeef tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:31:02.900631 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-55adc537-ac03-4551-8f5e-cb69d3b9eeef tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: fd5b9a34-32a4-436a-9aa6-89a7cae198a8] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:31:02.906595 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-55adc537-ac03-4551-8f5e-cb69d3b9eeef tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:31:02.907077 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-55adc537-ac03-4551-8f5e-cb69d3b9eeef tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:31:02.908415 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-55adc537-ac03-4551-8f5e-cb69d3b9eeef tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:31:02.908842 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-55adc537-ac03-4551-8f5e-cb69d3b9eeef tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:31:03.030590 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-55adc537-ac03-4551-8f5e-cb69d3b9eeef tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:31:03.038322 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-55adc537-ac03-4551-8f5e-cb69d3b9eeef tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8" status: 200 len: 1266 microversion: 2.1 time: 0.141955 Oct 12 04:31:03.038918 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 567/1119] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:31:02 2021] GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:31:03.765151 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-28cd0581-c08e-47f8-bc1e-1db71d1c8ffe req-05a228dd-645e-4f7d-b830-829785d81dea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5b9a34-32a4-436a-9aa6-89a7cae198a8", "name": "network-vif-plugged", "status": "completed", "tag": "3436ba7c-4372-4060-9d7d-55c76a050c80"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:31:03.766797 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:31:03.766797 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:31:03.773651 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-28cd0581-c08e-47f8-bc1e-1db71d1c8ffe req-05a228dd-645e-4f7d-b830-829785d81dea service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:31:03.774966 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-28cd0581-c08e-47f8-bc1e-1db71d1c8ffe req-05a228dd-645e-4f7d-b830-829785d81dea service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:31:03.784852 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-28cd0581-c08e-47f8-bc1e-1db71d1c8ffe req-05a228dd-645e-4f7d-b830-829785d81dea service nova] Creating event network-vif-plugged:3436ba7c-4372-4060-9d7d-55c76a050c80 for instance fd5b9a34-32a4-436a-9aa6-89a7cae198a8 on hv-cinder-81306 Oct 12 04:31:03.790385 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-28cd0581-c08e-47f8-bc1e-1db71d1c8ffe req-05a228dd-645e-4f7d-b830-829785d81dea service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028793 Oct 12 04:31:03.790993 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 553/1120] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:31:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:31:04.055104 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-6382726f-6fb2-4113-b564-e1e4e39e5c7d tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:31:04.055811 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-6382726f-6fb2-4113-b564-e1e4e39e5c7d tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: fd5b9a34-32a4-436a-9aa6-89a7cae198a8] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:31:04.061621 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6382726f-6fb2-4113-b564-e1e4e39e5c7d tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:31:04.062066 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6382726f-6fb2-4113-b564-e1e4e39e5c7d tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:31:04.062862 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6382726f-6fb2-4113-b564-e1e4e39e5c7d tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:31:04.063292 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-6382726f-6fb2-4113-b564-e1e4e39e5c7d tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:31:04.218167 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-6382726f-6fb2-4113-b564-e1e4e39e5c7d tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:31:04.226072 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-6382726f-6fb2-4113-b564-e1e4e39e5c7d tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8" status: 200 len: 1266 microversion: 2.1 time: 0.175204 Oct 12 04:31:04.226616 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 568/1121] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:31:04 2021] GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:31:05.243715 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d9de3d7f-3914-42b1-affb-c9d531230ebb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:31:05.244407 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-d9de3d7f-3914-42b1-affb-c9d531230ebb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: fd5b9a34-32a4-436a-9aa6-89a7cae198a8] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:31:05.250341 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d9de3d7f-3914-42b1-affb-c9d531230ebb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:31:05.250825 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d9de3d7f-3914-42b1-affb-c9d531230ebb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:31:05.251588 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d9de3d7f-3914-42b1-affb-c9d531230ebb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:31:05.252017 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d9de3d7f-3914-42b1-affb-c9d531230ebb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:31:05.378004 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-d9de3d7f-3914-42b1-affb-c9d531230ebb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:31:05.385815 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-d9de3d7f-3914-42b1-affb-c9d531230ebb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8" status: 200 len: 1266 microversion: 2.1 time: 0.146197 Oct 12 04:31:05.386477 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 554/1122] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:31:05 2021] GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:31:06.403152 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-b02a711d-f52c-4d37-b666-6b582776a39d tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:31:06.403784 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-b02a711d-f52c-4d37-b666-6b582776a39d tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: fd5b9a34-32a4-436a-9aa6-89a7cae198a8] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:31:06.409651 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b02a711d-f52c-4d37-b666-6b582776a39d tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:31:06.410731 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b02a711d-f52c-4d37-b666-6b582776a39d tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:31:06.411498 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b02a711d-f52c-4d37-b666-6b582776a39d tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:31:06.411930 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b02a711d-f52c-4d37-b666-6b582776a39d tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:31:06.528222 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-b02a711d-f52c-4d37-b666-6b582776a39d tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:31:06.535850 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-b02a711d-f52c-4d37-b666-6b582776a39d tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8" status: 200 len: 1452 microversion: 2.1 time: 0.135939 Oct 12 04:31:06.536410 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 569/1123] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:31:06 2021] GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8 => generated 1452 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:31:06.553186 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-15227be3-1533-4483-b0d4-623d9650cbea tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:31:06.554281 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-15227be3-1533-4483-b0d4-623d9650cbea tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: fd5b9a34-32a4-436a-9aa6-89a7cae198a8] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:31:06.560287 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-15227be3-1533-4483-b0d4-623d9650cbea tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:31:06.560736 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-15227be3-1533-4483-b0d4-623d9650cbea tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:31:06.561499 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-15227be3-1533-4483-b0d4-623d9650cbea tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:31:06.561932 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-15227be3-1533-4483-b0d4-623d9650cbea tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:31:06.679600 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-15227be3-1533-4483-b0d4-623d9650cbea tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:31:06.686812 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-15227be3-1533-4483-b0d4-623d9650cbea tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8" status: 200 len: 1452 microversion: 2.1 time: 0.139114 Oct 12 04:31:06.687375 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 555/1124] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:31:06 2021] GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8 => generated 1452 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:31:08.499265 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-300348dc-ccde-4157-88e5-952a8f5343e5 req-56dfb6ab-f312-4292-9bea-17f8c0608769 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd5b9a34-32a4-436a-9aa6-89a7cae198a8", "tag": "3436ba7c-4372-4060-9d7d-55c76a050c80"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:31:08.501123 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:31:08.501123 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:31:08.508456 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-300348dc-ccde-4157-88e5-952a8f5343e5 req-56dfb6ab-f312-4292-9bea-17f8c0608769 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:31:08.508893 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-300348dc-ccde-4157-88e5-952a8f5343e5 req-56dfb6ab-f312-4292-9bea-17f8c0608769 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:31:08.519412 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-300348dc-ccde-4157-88e5-952a8f5343e5 req-56dfb6ab-f312-4292-9bea-17f8c0608769 service nova] Creating event network-changed:3436ba7c-4372-4060-9d7d-55c76a050c80 for instance fd5b9a34-32a4-436a-9aa6-89a7cae198a8 on hv-cinder-81306 Oct 12 04:31:08.525058 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-300348dc-ccde-4157-88e5-952a8f5343e5 req-56dfb6ab-f312-4292-9bea-17f8c0608769 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029410 Oct 12 04:31:08.525642 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 570/1125] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:31:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:31:53.337801 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 04:31:53.338335 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: Tue Oct 12 04:31:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 12 04:32:00.563107 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 04:32:00.563689 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: Tue Oct 12 04:32:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 12 04:32:43.293366 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-d7b978d1-769f-4b1f-90a5-c30609710441 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1806320671", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2143205246", "security_groups": [{"name": "tempest-secgroup-smoke-649699211"}], "block_device_mapping_v2": [{"uuid": "f60ab5f6-3d5d-488b-9263-e824b58bd1f8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ec34bde3-5025-40d5-9384-8e9eb1870b7b"}]}} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:32:43.535535 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.network.neutron [None req-d7b978d1-769f-4b1f-90a5-c30609710441 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] validate_networks() for [('ec34bde3-5025-40d5-9384-8e9eb1870b7b', None, None, None, None, None)] {{(pid=108898) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 12 04:32:43.911499 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-d7b978d1-769f-4b1f-90a5-c30609710441 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Flavor limits 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 04:32:43.911942 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-d7b978d1-769f-4b1f-90a5-c30609710441 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Image limits 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 04:32:43.912407 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-d7b978d1-769f-4b1f-90a5-c30609710441 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Flavor pref 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 04:32:43.912806 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-d7b978d1-769f-4b1f-90a5-c30609710441 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Image pref 0:0:0 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 04:32:43.913238 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.virt.hardware [None req-d7b978d1-769f-4b1f-90a5-c30609710441 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 04:32:43.921512 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d7b978d1-769f-4b1f-90a5-c30609710441 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:32:43.921944 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d7b978d1-769f-4b1f-90a5-c30609710441 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:32:43.922753 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d7b978d1-769f-4b1f-90a5-c30609710441 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:32:43.923181 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-d7b978d1-769f-4b1f-90a5-c30609710441 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:32:43.939050 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-d7b978d1-769f-4b1f-90a5-c30609710441 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Getting quotas for project 07dacc449ddf4eacbce081796b99d647. Resources: {'cores', 'instances', 'ram'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 12 04:32:43.943377 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.quota [None req-d7b978d1-769f-4b1f-90a5-c30609710441 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Getting quotas for user 93aa7a5e0a074530ae9595e9debaf8aa and project 07dacc449ddf4eacbce081796b99d647. Resources: {'cores', 'instances', 'ram'} {{(pid=108898) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 12 04:32:44.006500 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-d7b978d1-769f-4b1f-90a5-c30609710441 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Going to run 1 instances... {{(pid=108898) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 12 04:32:44.009843 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-d7b978d1-769f-4b1f-90a5-c30609710441 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: b77908c0-ca08-49b7-b619-f8268ff59e0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f60ab5f6-3d5d-488b-9263-e824b58bd1f8',volume_size=None,volume_type=None)] {{(pid=108898) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 12 04:32:44.438135 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-d7b978d1-769f-4b1f-90a5-c30609710441 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.149136 Oct 12 04:32:44.438956 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 556/1126] 10.222.0.21 () {60 vars in 1146 bytes} [Tue Oct 12 04:32:43 2021] POST /compute/v2.1/servers => generated 405 bytes in 1151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 04:32:44.450293 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-122c63a3-ebdc-4109-a1ad-b28cce4b291f tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:32:44.451024 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-122c63a3-ebdc-4109-a1ad-b28cce4b291f tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: b77908c0-ca08-49b7-b619-f8268ff59e0d] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:32:44.565901 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-122c63a3-ebdc-4109-a1ad-b28cce4b291f tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:32:44.572821 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-122c63a3-ebdc-4109-a1ad-b28cce4b291f tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d" status: 200 len: 1095 microversion: 2.1 time: 0.127816 Oct 12 04:32:44.573295 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 571/1127] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:32:44 2021] GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d => generated 1095 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:32:45.589680 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-0a96f319-7dc8-4e10-be92-f5165085a750 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:32:45.590375 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-0a96f319-7dc8-4e10-be92-f5165085a750 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: b77908c0-ca08-49b7-b619-f8268ff59e0d] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:32:45.640732 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-0a96f319-7dc8-4e10-be92-f5165085a750 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:32:45.647821 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-0a96f319-7dc8-4e10-be92-f5165085a750 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d" status: 200 len: 1095 microversion: 2.1 time: 0.062302 Oct 12 04:32:45.648377 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 557/1128] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:32:45 2021] GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d => generated 1095 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:32:46.665134 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-006f29c7-3050-4220-8a5a-e4391c14b827 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:32:46.665737 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-006f29c7-3050-4220-8a5a-e4391c14b827 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: b77908c0-ca08-49b7-b619-f8268ff59e0d] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:32:46.671749 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-006f29c7-3050-4220-8a5a-e4391c14b827 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:32:46.672188 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-006f29c7-3050-4220-8a5a-e4391c14b827 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:32:46.672935 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-006f29c7-3050-4220-8a5a-e4391c14b827 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:32:46.673358 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-006f29c7-3050-4220-8a5a-e4391c14b827 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:32:46.729474 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-006f29c7-3050-4220-8a5a-e4391c14b827 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:32:46.736595 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-006f29c7-3050-4220-8a5a-e4391c14b827 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d" status: 200 len: 1145 microversion: 2.1 time: 0.075264 Oct 12 04:32:46.737136 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 572/1129] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:32:46 2021] GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d => generated 1145 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:32:47.757764 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-95be72fa-8562-431e-849a-c4f616d7d7d5 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:32:47.758365 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-95be72fa-8562-431e-849a-c4f616d7d7d5 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: b77908c0-ca08-49b7-b619-f8268ff59e0d] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:32:47.764334 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-95be72fa-8562-431e-849a-c4f616d7d7d5 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:32:47.764772 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-95be72fa-8562-431e-849a-c4f616d7d7d5 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:32:47.765520 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-95be72fa-8562-431e-849a-c4f616d7d7d5 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:32:47.765946 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-95be72fa-8562-431e-849a-c4f616d7d7d5 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:32:47.829138 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-95be72fa-8562-431e-849a-c4f616d7d7d5 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:32:47.836533 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-95be72fa-8562-431e-849a-c4f616d7d7d5 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d" status: 200 len: 1193 microversion: 2.1 time: 0.083047 Oct 12 04:32:47.837087 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 558/1130] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:32:47 2021] GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d => generated 1193 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 04:32:48.853487 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-e7c54c62-0881-4ac5-8efc-be4f9888a0c5 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:32:48.854153 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-e7c54c62-0881-4ac5-8efc-be4f9888a0c5 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: b77908c0-ca08-49b7-b619-f8268ff59e0d] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:32:48.864667 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e7c54c62-0881-4ac5-8efc-be4f9888a0c5 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:32:48.864667 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e7c54c62-0881-4ac5-8efc-be4f9888a0c5 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:32:48.864667 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e7c54c62-0881-4ac5-8efc-be4f9888a0c5 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:32:48.864667 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e7c54c62-0881-4ac5-8efc-be4f9888a0c5 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:32:49.001894 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-e7c54c62-0881-4ac5-8efc-be4f9888a0c5 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:32:49.009888 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-e7c54c62-0881-4ac5-8efc-be4f9888a0c5 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d" status: 200 len: 1278 microversion: 2.1 time: 0.160119 Oct 12 04:32:49.010427 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 573/1131] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:32:48 2021] GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:32:49.848472 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-f95f4498-0e75-4e35-bd55-dcc6e23cac8b req-38f98603-9ed5-4d73-80e0-49eab11c8120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b77908c0-ca08-49b7-b619-f8268ff59e0d", "tag": "6fb66914-ffb6-4751-bb9e-54ff7f1d361c"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:32:49.850202 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:32:49.850202 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:32:49.857188 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-f95f4498-0e75-4e35-bd55-dcc6e23cac8b req-38f98603-9ed5-4d73-80e0-49eab11c8120 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:32:49.857794 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-f95f4498-0e75-4e35-bd55-dcc6e23cac8b req-38f98603-9ed5-4d73-80e0-49eab11c8120 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:32:49.869078 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-f95f4498-0e75-4e35-bd55-dcc6e23cac8b req-38f98603-9ed5-4d73-80e0-49eab11c8120 service nova] Creating event network-changed:6fb66914-ffb6-4751-bb9e-54ff7f1d361c for instance b77908c0-ca08-49b7-b619-f8268ff59e0d on hv-cinder-81306 Oct 12 04:32:49.874213 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-f95f4498-0e75-4e35-bd55-dcc6e23cac8b req-38f98603-9ed5-4d73-80e0-49eab11c8120 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090571 Oct 12 04:32:49.875049 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 559/1132] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:32:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:32:50.027689 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-2ee05114-c4c0-4372-9e8b-9dc8470d4183 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:32:50.028540 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-2ee05114-c4c0-4372-9e8b-9dc8470d4183 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: b77908c0-ca08-49b7-b619-f8268ff59e0d] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:32:50.034774 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2ee05114-c4c0-4372-9e8b-9dc8470d4183 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:32:50.035641 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2ee05114-c4c0-4372-9e8b-9dc8470d4183 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:32:50.036434 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2ee05114-c4c0-4372-9e8b-9dc8470d4183 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:32:50.036861 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2ee05114-c4c0-4372-9e8b-9dc8470d4183 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:32:50.253392 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-2ee05114-c4c0-4372-9e8b-9dc8470d4183 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:32:50.261002 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-2ee05114-c4c0-4372-9e8b-9dc8470d4183 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d" status: 200 len: 1266 microversion: 2.1 time: 0.237288 Oct 12 04:32:50.261554 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 574/1133] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:32:50 2021] GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:32:51.278864 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-f33328f5-69c4-4f2b-90ea-f5026ee74185 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:32:51.279551 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-f33328f5-69c4-4f2b-90ea-f5026ee74185 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: b77908c0-ca08-49b7-b619-f8268ff59e0d] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:32:51.285966 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f33328f5-69c4-4f2b-90ea-f5026ee74185 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:32:51.286404 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f33328f5-69c4-4f2b-90ea-f5026ee74185 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:32:51.287179 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f33328f5-69c4-4f2b-90ea-f5026ee74185 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:32:51.287603 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-f33328f5-69c4-4f2b-90ea-f5026ee74185 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:32:51.403549 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-f33328f5-69c4-4f2b-90ea-f5026ee74185 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:32:51.411289 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-f33328f5-69c4-4f2b-90ea-f5026ee74185 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d" status: 200 len: 1266 microversion: 2.1 time: 0.136420 Oct 12 04:32:51.411843 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 560/1134] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:32:51 2021] GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:32:52.427910 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-2069baea-b609-49d9-8372-acd0c5931bf6 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:32:52.428511 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-2069baea-b609-49d9-8372-acd0c5931bf6 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: b77908c0-ca08-49b7-b619-f8268ff59e0d] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:32:52.434274 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2069baea-b609-49d9-8372-acd0c5931bf6 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:32:52.434738 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2069baea-b609-49d9-8372-acd0c5931bf6 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:32:52.435490 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2069baea-b609-49d9-8372-acd0c5931bf6 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:32:52.435913 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2069baea-b609-49d9-8372-acd0c5931bf6 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:32:52.550069 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-2069baea-b609-49d9-8372-acd0c5931bf6 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:32:52.557755 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-2069baea-b609-49d9-8372-acd0c5931bf6 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d" status: 200 len: 1266 microversion: 2.1 time: 0.134084 Oct 12 04:32:52.558296 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 575/1135] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:32:52 2021] GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d => generated 1266 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:32:53.574292 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-8180ad3a-c25f-4ae7-a07c-91db9edee9eb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:32:53.574919 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-8180ad3a-c25f-4ae7-a07c-91db9edee9eb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: b77908c0-ca08-49b7-b619-f8268ff59e0d] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:32:53.580635 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8180ad3a-c25f-4ae7-a07c-91db9edee9eb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:32:53.581077 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8180ad3a-c25f-4ae7-a07c-91db9edee9eb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:32:53.581833 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8180ad3a-c25f-4ae7-a07c-91db9edee9eb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:32:53.582267 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-8180ad3a-c25f-4ae7-a07c-91db9edee9eb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:32:53.700387 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-8180ad3a-c25f-4ae7-a07c-91db9edee9eb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:32:53.707416 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-8180ad3a-c25f-4ae7-a07c-91db9edee9eb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d" status: 200 len: 1266 microversion: 2.1 time: 0.136857 Oct 12 04:32:53.707977 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 561/1136] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:32:53 2021] GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:32:54.724129 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-5f9665f5-6714-4353-bdec-920c58cdcf4f tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:32:54.724644 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-5f9665f5-6714-4353-bdec-920c58cdcf4f tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: b77908c0-ca08-49b7-b619-f8268ff59e0d] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:32:54.730405 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5f9665f5-6714-4353-bdec-920c58cdcf4f tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:32:54.730877 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5f9665f5-6714-4353-bdec-920c58cdcf4f tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:32:54.731632 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5f9665f5-6714-4353-bdec-920c58cdcf4f tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:32:54.732056 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-5f9665f5-6714-4353-bdec-920c58cdcf4f tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:32:54.853545 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-5f9665f5-6714-4353-bdec-920c58cdcf4f tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:32:54.860631 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-5f9665f5-6714-4353-bdec-920c58cdcf4f tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d" status: 200 len: 1266 microversion: 2.1 time: 0.140466 Oct 12 04:32:54.861177 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 576/1137] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:32:54 2021] GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:32:55.877170 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-6ffa5c11-3e2d-4a6c-9b6e-605f601c72c2 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:32:55.877772 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-6ffa5c11-3e2d-4a6c-9b6e-605f601c72c2 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: b77908c0-ca08-49b7-b619-f8268ff59e0d] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:32:55.883558 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6ffa5c11-3e2d-4a6c-9b6e-605f601c72c2 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:32:55.883996 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6ffa5c11-3e2d-4a6c-9b6e-605f601c72c2 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:32:55.884744 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6ffa5c11-3e2d-4a6c-9b6e-605f601c72c2 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:32:55.885171 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-6ffa5c11-3e2d-4a6c-9b6e-605f601c72c2 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:32:55.999484 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-6ffa5c11-3e2d-4a6c-9b6e-605f601c72c2 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:32:56.006460 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-6ffa5c11-3e2d-4a6c-9b6e-605f601c72c2 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d" status: 200 len: 1266 microversion: 2.1 time: 0.132913 Oct 12 04:32:56.007046 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 562/1138] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:32:55 2021] GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d => generated 1266 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:32:57.022970 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-ccb0bbd0-1b05-4a37-a037-c997c4badafa tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:32:57.023517 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-ccb0bbd0-1b05-4a37-a037-c997c4badafa tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: b77908c0-ca08-49b7-b619-f8268ff59e0d] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:32:57.029498 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ccb0bbd0-1b05-4a37-a037-c997c4badafa tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:32:57.029937 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ccb0bbd0-1b05-4a37-a037-c997c4badafa tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:32:57.030708 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ccb0bbd0-1b05-4a37-a037-c997c4badafa tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:32:57.031140 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-ccb0bbd0-1b05-4a37-a037-c997c4badafa tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:32:57.166393 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-ccb0bbd0-1b05-4a37-a037-c997c4badafa tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:32:57.173498 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-ccb0bbd0-1b05-4a37-a037-c997c4badafa tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d" status: 200 len: 1266 microversion: 2.1 time: 0.154269 Oct 12 04:32:57.174046 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 577/1139] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:32:57 2021] GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:32:58.190805 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-ae51e591-a7a8-4596-9305-1d2ca7e20166 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:32:58.191980 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-ae51e591-a7a8-4596-9305-1d2ca7e20166 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: b77908c0-ca08-49b7-b619-f8268ff59e0d] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:32:58.197656 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ae51e591-a7a8-4596-9305-1d2ca7e20166 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:32:58.198098 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ae51e591-a7a8-4596-9305-1d2ca7e20166 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:32:58.198888 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ae51e591-a7a8-4596-9305-1d2ca7e20166 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:32:58.199315 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-ae51e591-a7a8-4596-9305-1d2ca7e20166 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:32:58.318955 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-ae51e591-a7a8-4596-9305-1d2ca7e20166 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:32:58.326213 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-ae51e591-a7a8-4596-9305-1d2ca7e20166 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d" status: 200 len: 1266 microversion: 2.1 time: 0.139173 Oct 12 04:32:58.335571 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 563/1140] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:32:58 2021] GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:32:59.342837 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-00ec7860-eefa-486e-b837-b2ea7e3d8cf5 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:32:59.343441 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-00ec7860-eefa-486e-b837-b2ea7e3d8cf5 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: b77908c0-ca08-49b7-b619-f8268ff59e0d] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:32:59.349441 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-00ec7860-eefa-486e-b837-b2ea7e3d8cf5 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:32:59.349880 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-00ec7860-eefa-486e-b837-b2ea7e3d8cf5 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:32:59.350625 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-00ec7860-eefa-486e-b837-b2ea7e3d8cf5 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:32:59.351073 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-00ec7860-eefa-486e-b837-b2ea7e3d8cf5 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:32:59.467499 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-00ec7860-eefa-486e-b837-b2ea7e3d8cf5 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:32:59.474733 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-00ec7860-eefa-486e-b837-b2ea7e3d8cf5 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d" status: 200 len: 1266 microversion: 2.1 time: 0.135454 Oct 12 04:32:59.478857 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 578/1141] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:32:59 2021] GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:33:00.270435 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [req-803e5a86-ef8a-4883-adf6-b2af82555bdc req-d252e368-f9f5-4890-b08a-82a565e5902d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b77908c0-ca08-49b7-b619-f8268ff59e0d", "name": "network-vif-plugged", "status": "completed", "tag": "6fb66914-ffb6-4751-bb9e-54ff7f1d361c"}]} {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:33:00.272185 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:33:00.272185 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: warnings.warn(msg) Oct 12 04:33:00.278830 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-803e5a86-ef8a-4883-adf6-b2af82555bdc req-d252e368-f9f5-4890-b08a-82a565e5902d service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:33:00.279270 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [req-803e5a86-ef8a-4883-adf6-b2af82555bdc req-d252e368-f9f5-4890-b08a-82a565e5902d service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:33:00.290167 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.compute.server_external_events [req-803e5a86-ef8a-4883-adf6-b2af82555bdc req-d252e368-f9f5-4890-b08a-82a565e5902d service nova] Creating event network-vif-plugged:6fb66914-ffb6-4751-bb9e-54ff7f1d361c for instance b77908c0-ca08-49b7-b619-f8268ff59e0d on hv-cinder-81306 Oct 12 04:33:00.295268 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [req-803e5a86-ef8a-4883-adf6-b2af82555bdc req-d252e368-f9f5-4890-b08a-82a565e5902d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028200 Oct 12 04:33:00.295832 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 564/1142] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:33:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:33:00.491485 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-2aec7df6-af23-4e24-887d-e7ffef29a6af tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:33:00.492085 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-2aec7df6-af23-4e24-887d-e7ffef29a6af tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: b77908c0-ca08-49b7-b619-f8268ff59e0d] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:33:00.497800 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2aec7df6-af23-4e24-887d-e7ffef29a6af tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:33:00.498250 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2aec7df6-af23-4e24-887d-e7ffef29a6af tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:33:00.499042 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2aec7df6-af23-4e24-887d-e7ffef29a6af tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:33:00.499474 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-2aec7df6-af23-4e24-887d-e7ffef29a6af tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:33:00.620140 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-2aec7df6-af23-4e24-887d-e7ffef29a6af tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:33:00.628103 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-2aec7df6-af23-4e24-887d-e7ffef29a6af tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d" status: 200 len: 1266 microversion: 2.1 time: 0.140345 Oct 12 04:33:00.628649 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 579/1143] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:33:00 2021] GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:33:01.646131 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-66c5e83f-f785-4365-9dd4-bbbb9161c936 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:33:01.646797 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-66c5e83f-f785-4365-9dd4-bbbb9161c936 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: b77908c0-ca08-49b7-b619-f8268ff59e0d] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:33:01.652828 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-66c5e83f-f785-4365-9dd4-bbbb9161c936 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:33:01.653275 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-66c5e83f-f785-4365-9dd4-bbbb9161c936 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:33:01.654039 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-66c5e83f-f785-4365-9dd4-bbbb9161c936 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:33:01.654474 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-66c5e83f-f785-4365-9dd4-bbbb9161c936 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:33:01.776230 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-66c5e83f-f785-4365-9dd4-bbbb9161c936 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:33:01.783565 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-66c5e83f-f785-4365-9dd4-bbbb9161c936 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d" status: 200 len: 1266 microversion: 2.1 time: 0.141511 Oct 12 04:33:01.784117 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 565/1144] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:33:01 2021] GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:33:02.801012 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-d759dc55-a47b-40d1-b1e9-5d17d759d9b7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:33:02.801659 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-d759dc55-a47b-40d1-b1e9-5d17d759d9b7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: b77908c0-ca08-49b7-b619-f8268ff59e0d] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:33:02.807491 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d759dc55-a47b-40d1-b1e9-5d17d759d9b7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:33:02.807925 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d759dc55-a47b-40d1-b1e9-5d17d759d9b7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:33:02.808672 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d759dc55-a47b-40d1-b1e9-5d17d759d9b7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:33:02.809096 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-d759dc55-a47b-40d1-b1e9-5d17d759d9b7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:33:02.943873 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-d759dc55-a47b-40d1-b1e9-5d17d759d9b7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:33:02.950906 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-d759dc55-a47b-40d1-b1e9-5d17d759d9b7 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d" status: 200 len: 1452 microversion: 2.1 time: 0.154043 Oct 12 04:33:02.951451 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 580/1145] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:33:02 2021] GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:33:02.966232 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-c741632f-212a-42e5-9f75-174631e21ec3 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:33:02.966869 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-c741632f-212a-42e5-9f75-174631e21ec3 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: b77908c0-ca08-49b7-b619-f8268ff59e0d] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:33:02.973235 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c741632f-212a-42e5-9f75-174631e21ec3 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:33:02.973674 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c741632f-212a-42e5-9f75-174631e21ec3 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:33:02.974419 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c741632f-212a-42e5-9f75-174631e21ec3 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:33:02.974869 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-c741632f-212a-42e5-9f75-174631e21ec3 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:33:03.089553 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-c741632f-212a-42e5-9f75-174631e21ec3 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:33:03.096724 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-c741632f-212a-42e5-9f75-174631e21ec3 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d" status: 200 len: 1452 microversion: 2.1 time: 0.134070 Oct 12 04:33:03.098036 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 566/1146] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:33:02 2021] GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d => generated 1452 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:33:05.244549 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-77889e23-2ac7-4ceb-b00f-c91f227e50c9 req-406b45c5-96b2-4214-b213-b1f0577abc76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b77908c0-ca08-49b7-b619-f8268ff59e0d", "tag": "6fb66914-ffb6-4751-bb9e-54ff7f1d361c"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:33:05.246982 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:33:05.246982 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:33:05.254243 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-77889e23-2ac7-4ceb-b00f-c91f227e50c9 req-406b45c5-96b2-4214-b213-b1f0577abc76 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:33:05.254701 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-77889e23-2ac7-4ceb-b00f-c91f227e50c9 req-406b45c5-96b2-4214-b213-b1f0577abc76 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:33:05.266038 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-77889e23-2ac7-4ceb-b00f-c91f227e50c9 req-406b45c5-96b2-4214-b213-b1f0577abc76 service nova] Creating event network-changed:6fb66914-ffb6-4751-bb9e-54ff7f1d361c for instance b77908c0-ca08-49b7-b619-f8268ff59e0d on hv-cinder-81306 Oct 12 04:33:05.271641 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-77889e23-2ac7-4ceb-b00f-c91f227e50c9 req-406b45c5-96b2-4214-b213-b1f0577abc76 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031052 Oct 12 04:33:05.275157 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 581/1147] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:33:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:34:04.075655 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 04:34:04.076359 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: Tue Oct 12 04:34:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 12 04:34:33.114067 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0cef7165-6256-471b-b282-b35f994dd139] AMQP server on 10.222.0.21:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 04:34:33.117442 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-40d392eb-968e-4f8f-9e55-abf301bba433 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:34:33.118198 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-40d392eb-968e-4f8f-9e55-abf301bba433 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: b77908c0-ca08-49b7-b619-f8268ff59e0d] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:34:33.120655 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-598edf76-a496-4a6f-a951-bb79e6b0922f req-153cb3af-6528-4852-898e-9436d41009bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b77908c0-ca08-49b7-b619-f8268ff59e0d", "tag": "6fb66914-ffb6-4751-bb9e-54ff7f1d361c"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:34:33.122979 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:34:33.122979 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:34:33.124350 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-40d392eb-968e-4f8f-9e55-abf301bba433 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:34:33.124868 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-40d392eb-968e-4f8f-9e55-abf301bba433 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:34:33.125764 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-40d392eb-968e-4f8f-9e55-abf301bba433 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:34:33.126359 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-40d392eb-968e-4f8f-9e55-abf301bba433 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:34:33.130211 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-598edf76-a496-4a6f-a951-bb79e6b0922f req-153cb3af-6528-4852-898e-9436d41009bd service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:34:33.132554 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-598edf76-a496-4a6f-a951-bb79e6b0922f req-153cb3af-6528-4852-898e-9436d41009bd service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:34:33.141609 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-598edf76-a496-4a6f-a951-bb79e6b0922f req-153cb3af-6528-4852-898e-9436d41009bd service nova] Creating event network-changed:6fb66914-ffb6-4751-bb9e-54ff7f1d361c for instance b77908c0-ca08-49b7-b619-f8268ff59e0d on hv-cinder-81306 Oct 12 04:34:33.147588 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-598edf76-a496-4a6f-a951-bb79e6b0922f req-153cb3af-6528-4852-898e-9436d41009bd service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032071 Oct 12 04:34:33.148506 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 582/1148] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:34:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:34:33.152265 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-40d392eb-968e-4f8f-9e55-abf301bba433 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: b77908c0-ca08-49b7-b619-f8268ff59e0d] Going to try to terminate instance {{(pid=108898) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 04:34:33.453761 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-40d392eb-968e-4f8f-9e55-abf301bba433 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "DELETE /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d" status: 204 len: 0 microversion: 2.1 time: 0.342016 Oct 12 04:34:33.457865 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 567/1149] 10.222.0.21 () {58 vars in 1238 bytes} [Tue Oct 12 04:34:33 2021] DELETE /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 04:34:33.463935 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-e0afbcf6-81d2-4c17-8364-87312650689e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:34:33.464894 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-e0afbcf6-81d2-4c17-8364-87312650689e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: b77908c0-ca08-49b7-b619-f8268ff59e0d] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:34:33.473633 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e0afbcf6-81d2-4c17-8364-87312650689e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:34:33.475854 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e0afbcf6-81d2-4c17-8364-87312650689e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:34:33.476645 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e0afbcf6-81d2-4c17-8364-87312650689e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:34:33.477077 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-e0afbcf6-81d2-4c17-8364-87312650689e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:34:33.705506 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-e0afbcf6-81d2-4c17-8364-87312650689e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:34:33.713287 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-e0afbcf6-81d2-4c17-8364-87312650689e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d" status: 200 len: 1575 microversion: 2.1 time: 0.253460 Oct 12 04:34:33.714521 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 583/1150] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:34:33 2021] GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d => generated 1575 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:34:34.742553 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-79f4305a-8dcd-4516-a7ba-bc46c5331c32 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:34:34.743320 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-79f4305a-8dcd-4516-a7ba-bc46c5331c32 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: b77908c0-ca08-49b7-b619-f8268ff59e0d] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:34:34.750117 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-79f4305a-8dcd-4516-a7ba-bc46c5331c32 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:34:34.750557 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-79f4305a-8dcd-4516-a7ba-bc46c5331c32 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:34:34.751509 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-79f4305a-8dcd-4516-a7ba-bc46c5331c32 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:34:34.751798 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-79f4305a-8dcd-4516-a7ba-bc46c5331c32 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:34:34.766678 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO oslo.messaging._drivers.impl_rabbit [-] [0cef7165-6256-471b-b282-b35f994dd139] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 39130. Oct 12 04:34:34.878777 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-79f4305a-8dcd-4516-a7ba-bc46c5331c32 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:34:34.883050 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-79f4305a-8dcd-4516-a7ba-bc46c5331c32 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d" status: 200 len: 1458 microversion: 2.1 time: 0.155521 Oct 12 04:34:34.883669 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 568/1151] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:34:34 2021] GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d => generated 1458 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:34:35.578878 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-e9eb4362-6388-468a-9811-88a650974d82 req-b06dda3e-38a5-428f-bc7b-f8dbdb8170ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b77908c0-ca08-49b7-b619-f8268ff59e0d", "name": "network-vif-deleted", "tag": "6fb66914-ffb6-4751-bb9e-54ff7f1d361c"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:34:35.578878 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:34:35.578878 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:34:35.578878 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-e9eb4362-6388-468a-9811-88a650974d82 req-b06dda3e-38a5-428f-bc7b-f8dbdb8170ef service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:34:35.578878 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-e9eb4362-6388-468a-9811-88a650974d82 req-b06dda3e-38a5-428f-bc7b-f8dbdb8170ef service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:34:35.607411 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-e9eb4362-6388-468a-9811-88a650974d82 req-b06dda3e-38a5-428f-bc7b-f8dbdb8170ef service nova] Creating event network-vif-deleted:6fb66914-ffb6-4751-bb9e-54ff7f1d361c for instance b77908c0-ca08-49b7-b619-f8268ff59e0d on hv-cinder-81306 Oct 12 04:34:35.607411 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-e9eb4362-6388-468a-9811-88a650974d82 req-b06dda3e-38a5-428f-bc7b-f8dbdb8170ef service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027987 Oct 12 04:34:35.607411 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 584/1152] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:34:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:34:35.946980 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-cbb7b735-3f20-423e-80a7-72b30c315493 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:34:35.947589 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-cbb7b735-3f20-423e-80a7-72b30c315493 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: b77908c0-ca08-49b7-b619-f8268ff59e0d] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:34:35.953360 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-cbb7b735-3f20-423e-80a7-72b30c315493 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:34:35.953789 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-cbb7b735-3f20-423e-80a7-72b30c315493 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:34:35.954539 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-cbb7b735-3f20-423e-80a7-72b30c315493 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:34:35.955062 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-cbb7b735-3f20-423e-80a7-72b30c315493 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:34:36.013642 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-cbb7b735-3f20-423e-80a7-72b30c315493 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:34:36.020918 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-cbb7b735-3f20-423e-80a7-72b30c315493 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d" status: 200 len: 1226 microversion: 2.1 time: 0.077598 Oct 12 04:34:36.021473 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 569/1153] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:34:35 2021] GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:34:37.038294 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-87563bf6-8a17-4f6f-863c-82483d6c257e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:34:37.038933 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-87563bf6-8a17-4f6f-863c-82483d6c257e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: b77908c0-ca08-49b7-b619-f8268ff59e0d] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:34:37.044895 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-87563bf6-8a17-4f6f-863c-82483d6c257e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:34:37.045339 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-87563bf6-8a17-4f6f-863c-82483d6c257e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:34:37.046117 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-87563bf6-8a17-4f6f-863c-82483d6c257e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:34:37.046546 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-87563bf6-8a17-4f6f-863c-82483d6c257e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:34:37.059475 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.wsgi [None req-87563bf6-8a17-4f6f-863c-82483d6c257e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] HTTP exception thrown: Instance b77908c0-ca08-49b7-b619-f8268ff59e0d could not be found. Oct 12 04:34:37.060044 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-87563bf6-8a17-4f6f-863c-82483d6c257e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Returning 404 to user: Instance b77908c0-ca08-49b7-b619-f8268ff59e0d could not be found. {{(pid=108897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:34:37.060867 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-87563bf6-8a17-4f6f-863c-82483d6c257e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d" status: 404 len: 111 microversion: 2.1 time: 0.026696 Oct 12 04:34:37.061358 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 585/1154] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:34:37 2021] GET /compute/v2.1/servers/b77908c0-ca08-49b7-b619-f8268ff59e0d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:34:40.608171 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-49de6c35-e053-4e8e-8e95-82480e48c8d6 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:34:40.608666 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-49de6c35-e053-4e8e-8e95-82480e48c8d6 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: fd5b9a34-32a4-436a-9aa6-89a7cae198a8] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:34:40.610447 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-8e09468c-bc6e-4380-b4ab-cf467e7d7412 req-f249d038-51ee-4eed-8ae1-fd4e0803e2af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd5b9a34-32a4-436a-9aa6-89a7cae198a8", "tag": "3436ba7c-4372-4060-9d7d-55c76a050c80"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:34:40.612682 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:34:40.612682 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:34:40.615357 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-49de6c35-e053-4e8e-8e95-82480e48c8d6 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:34:40.615868 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-49de6c35-e053-4e8e-8e95-82480e48c8d6 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:34:40.616700 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-49de6c35-e053-4e8e-8e95-82480e48c8d6 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:34:40.617200 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-49de6c35-e053-4e8e-8e95-82480e48c8d6 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:34:40.619626 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-8e09468c-bc6e-4380-b4ab-cf467e7d7412 req-f249d038-51ee-4eed-8ae1-fd4e0803e2af service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:34:40.620065 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-8e09468c-bc6e-4380-b4ab-cf467e7d7412 req-f249d038-51ee-4eed-8ae1-fd4e0803e2af service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:34:40.631350 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-8e09468c-bc6e-4380-b4ab-cf467e7d7412 req-f249d038-51ee-4eed-8ae1-fd4e0803e2af service nova] Creating event network-changed:3436ba7c-4372-4060-9d7d-55c76a050c80 for instance fd5b9a34-32a4-436a-9aa6-89a7cae198a8 on hv-cinder-81306 Oct 12 04:34:40.635990 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-8e09468c-bc6e-4380-b4ab-cf467e7d7412 req-f249d038-51ee-4eed-8ae1-fd4e0803e2af service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028970 Oct 12 04:34:40.636959 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 586/1155] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:34:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 04:34:40.642057 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-49de6c35-e053-4e8e-8e95-82480e48c8d6 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: fd5b9a34-32a4-436a-9aa6-89a7cae198a8] Going to try to terminate instance {{(pid=108898) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 12 04:34:40.915950 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-49de6c35-e053-4e8e-8e95-82480e48c8d6 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "DELETE /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8" status: 204 len: 0 microversion: 2.1 time: 0.311364 Oct 12 04:34:40.920059 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 570/1156] 10.222.0.21 () {58 vars in 1238 bytes} [Tue Oct 12 04:34:40 2021] DELETE /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 04:34:40.926210 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-dc891265-01a9-4147-8c67-3e8caba2f81e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:34:40.926949 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-dc891265-01a9-4147-8c67-3e8caba2f81e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: fd5b9a34-32a4-436a-9aa6-89a7cae198a8] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:34:40.933279 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-dc891265-01a9-4147-8c67-3e8caba2f81e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:34:40.933731 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-dc891265-01a9-4147-8c67-3e8caba2f81e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:34:40.934520 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-dc891265-01a9-4147-8c67-3e8caba2f81e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:34:40.934990 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-dc891265-01a9-4147-8c67-3e8caba2f81e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:34:41.171384 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.policy [None req-dc891265-01a9-4147-8c67-3e8caba2f81e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:34:41.178581 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-dc891265-01a9-4147-8c67-3e8caba2f81e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8" status: 200 len: 1577 microversion: 2.1 time: 0.257071 Oct 12 04:34:41.179182 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 587/1157] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:34:40 2021] GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8 => generated 1577 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:34:42.196431 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-1fcfde34-cbb3-4e19-9f96-10d7b7c8ceb9 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:34:42.197181 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-1fcfde34-cbb3-4e19-9f96-10d7b7c8ceb9 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: fd5b9a34-32a4-436a-9aa6-89a7cae198a8] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:34:42.202956 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1fcfde34-cbb3-4e19-9f96-10d7b7c8ceb9 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:34:42.203402 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1fcfde34-cbb3-4e19-9f96-10d7b7c8ceb9 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:34:42.204163 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1fcfde34-cbb3-4e19-9f96-10d7b7c8ceb9 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:34:42.204592 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-1fcfde34-cbb3-4e19-9f96-10d7b7c8ceb9 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:34:42.326241 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-1fcfde34-cbb3-4e19-9f96-10d7b7c8ceb9 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:34:42.333827 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-1fcfde34-cbb3-4e19-9f96-10d7b7c8ceb9 tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8" status: 200 len: 1458 microversion: 2.1 time: 0.141422 Oct 12 04:34:42.334391 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 571/1158] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:34:42 2021] GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8 => generated 1458 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:34:42.927077 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [req-800555aa-965e-4c0c-896c-891c3fc4e417 req-d9ad3bbc-8f48-4b43-888f-e93e2e43d144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5b9a34-32a4-436a-9aa6-89a7cae198a8", "name": "network-vif-deleted", "tag": "3436ba7c-4372-4060-9d7d-55c76a050c80"}]} {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 04:34:42.928552 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:34:42.928552 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: warnings.warn(msg) Oct 12 04:34:42.935279 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-800555aa-965e-4c0c-896c-891c3fc4e417 req-d9ad3bbc-8f48-4b43-888f-e93e2e43d144 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:34:42.935716 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [req-800555aa-965e-4c0c-896c-891c3fc4e417 req-d9ad3bbc-8f48-4b43-888f-e93e2e43d144 service nova] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:34:42.946478 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.compute.server_external_events [req-800555aa-965e-4c0c-896c-891c3fc4e417 req-d9ad3bbc-8f48-4b43-888f-e93e2e43d144 service nova] Creating event network-vif-deleted:3436ba7c-4372-4060-9d7d-55c76a050c80 for instance fd5b9a34-32a4-436a-9aa6-89a7cae198a8 on hv-cinder-81306 Oct 12 04:34:42.951260 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [req-800555aa-965e-4c0c-896c-891c3fc4e417 req-d9ad3bbc-8f48-4b43-888f-e93e2e43d144 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027692 Oct 12 04:34:42.951811 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 588/1159] 10.222.0.21 () {64 vars in 1317 bytes} [Tue Oct 12 04:34:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 04:34:43.350946 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-44eea197-d524-445b-84ad-35aff85d4efb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:34:43.351546 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-44eea197-d524-445b-84ad-35aff85d4efb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: fd5b9a34-32a4-436a-9aa6-89a7cae198a8] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:34:43.357325 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-44eea197-d524-445b-84ad-35aff85d4efb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:34:43.357762 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-44eea197-d524-445b-84ad-35aff85d4efb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:34:43.358508 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-44eea197-d524-445b-84ad-35aff85d4efb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:34:43.358963 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-44eea197-d524-445b-84ad-35aff85d4efb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:34:43.423254 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.policy [None req-44eea197-d524-445b-84ad-35aff85d4efb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93aa7a5e0a074530ae9595e9debaf8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dacc449ddf4eacbce081796b99d647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108898) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 04:34:43.431074 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-44eea197-d524-445b-84ad-35aff85d4efb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8" status: 200 len: 1226 microversion: 2.1 time: 0.083953 Oct 12 04:34:43.451028 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 572/1160] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:34:43 2021] GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 04:34:44.447386 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-0a584dfb-93de-49b9-b611-81ca9d48daed tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:34:44.448070 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-0a584dfb-93de-49b9-b611-81ca9d48daed tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: fd5b9a34-32a4-436a-9aa6-89a7cae198a8] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:34:44.453940 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0a584dfb-93de-49b9-b611-81ca9d48daed tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:34:44.454377 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0a584dfb-93de-49b9-b611-81ca9d48daed tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:34:44.455151 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0a584dfb-93de-49b9-b611-81ca9d48daed tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:34:44.455573 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-0a584dfb-93de-49b9-b611-81ca9d48daed tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:34:44.468720 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.wsgi [None req-0a584dfb-93de-49b9-b611-81ca9d48daed tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] HTTP exception thrown: Instance fd5b9a34-32a4-436a-9aa6-89a7cae198a8 could not be found. Oct 12 04:34:44.469288 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-0a584dfb-93de-49b9-b611-81ca9d48daed tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Returning 404 to user: Instance fd5b9a34-32a4-436a-9aa6-89a7cae198a8 could not be found. {{(pid=108897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:34:44.470068 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-0a584dfb-93de-49b9-b611-81ca9d48daed tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8" status: 404 len: 111 microversion: 2.1 time: 0.026702 Oct 12 04:34:44.470553 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 589/1161] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:34:44 2021] GET /compute/v2.1/servers/fd5b9a34-32a4-436a-9aa6-89a7cae198a8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:34:44.977401 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-4593946d-0f21-45df-b5f4-007e5ad2f27e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:34:44.977888 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.compute.api [None req-4593946d-0f21-45df-b5f4-007e5ad2f27e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] Fetching instance by UUID {{(pid=108898) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:34:44.983789 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4593946d-0f21-45df-b5f4-007e5ad2f27e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:34:44.984229 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4593946d-0f21-45df-b5f4-007e5ad2f27e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:34:44.984977 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4593946d-0f21-45df-b5f4-007e5ad2f27e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:34:44.985402 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG oslo_concurrency.lockutils [None req-4593946d-0f21-45df-b5f4-007e5ad2f27e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:34:44.998647 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.wsgi [None req-4593946d-0f21-45df-b5f4-007e5ad2f27e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] HTTP exception thrown: Instance 7ca30d68-1c68-4f1f-8edb-690294e9a5f2 could not be found. Oct 12 04:34:44.999243 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-4593946d-0f21-45df-b5f4-007e5ad2f27e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Returning 404 to user: Instance 7ca30d68-1c68-4f1f-8edb-690294e9a5f2 could not be found. {{(pid=108898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:34:45.000039 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-4593946d-0f21-45df-b5f4-007e5ad2f27e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "DELETE /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2" status: 404 len: 111 microversion: 2.1 time: 0.026327 Oct 12 04:34:45.000544 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 573/1162] 10.222.0.21 () {58 vars in 1238 bytes} [Tue Oct 12 04:34:44 2021] DELETE /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 04:34:45.006014 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c175fb9-c815-43ae-82fc-42b6c7387c8c] AMQP server on 10.222.0.21:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 04:34:45.009321 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-b7c5b9b7-2b7a-4ae6-a604-3f04aed3f27e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '>' {{(pid=108897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:34:45.009860 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.compute.api [None req-b7c5b9b7-2b7a-4ae6-a604-3f04aed3f27e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] [instance: 7ca30d68-1c68-4f1f-8edb-690294e9a5f2] Fetching instance by UUID {{(pid=108897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 12 04:34:45.015539 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b7c5b9b7-2b7a-4ae6-a604-3f04aed3f27e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:34:45.015980 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b7c5b9b7-2b7a-4ae6-a604-3f04aed3f27e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:34:45.016726 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b7c5b9b7-2b7a-4ae6-a604-3f04aed3f27e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 12 04:34:45.017156 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG oslo_concurrency.lockutils [None req-b7c5b9b7-2b7a-4ae6-a604-3f04aed3f27e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Lock "455ec794-f329-435f-873e-870ca7b342b6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 12 04:34:45.029517 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.wsgi [None req-b7c5b9b7-2b7a-4ae6-a604-3f04aed3f27e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] HTTP exception thrown: Instance 7ca30d68-1c68-4f1f-8edb-690294e9a5f2 could not be found. Oct 12 04:34:45.030083 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: DEBUG nova.api.openstack.wsgi [None req-b7c5b9b7-2b7a-4ae6-a604-3f04aed3f27e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Returning 404 to user: Instance 7ca30d68-1c68-4f1f-8edb-690294e9a5f2 could not be found. {{(pid=108897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 12 04:34:45.030894 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO nova.api.openstack.requestlog [None req-b7c5b9b7-2b7a-4ae6-a604-3f04aed3f27e tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2" status: 404 len: 111 microversion: 2.1 time: 0.026225 Oct 12 04:34:45.031388 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: [pid: 108897|app: 0|req: 590/1163] 10.222.0.21 () {58 vars in 1235 bytes} [Tue Oct 12 04:34:45 2021] GET /compute/v2.1/servers/7ca30d68-1c68-4f1f-8edb-690294e9a5f2 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 04:34:46.545348 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: DEBUG nova.api.openstack.wsgi [None req-1060a04e-a77b-482a-ad1c-da3d84af90eb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] Calling method '.version_select at 0x7f38553f70d0>' {{(pid=108898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 04:34:46.622133 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO nova.api.openstack.requestlog [None req-1060a04e-a77b-482a-ad1c-da3d84af90eb tempest-TestVolumeBootPattern-230818390 tempest-TestVolumeBootPattern-230818390-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2143205246" status: 202 len: 0 microversion: 2.1 time: 0.080339 Oct 12 04:34:46.622724 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: [pid: 108898|app: 0|req: 574/1164] 10.222.0.21 () {58 vars in 1262 bytes} [Tue Oct 12 04:34:46 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2143205246 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 04:35:13.355431 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 04:35:13.356025 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: Tue Oct 12 04:35:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 12 04:35:15.273374 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 04:35:15.274467 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: Tue Oct 12 04:35:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 12 04:37:00.582648 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 04:37:00.583440 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: Tue Oct 12 04:37:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 12 04:37:08.117044 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 04:37:08.117598 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: Tue Oct 12 04:37:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 12 04:37:11.444223 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 04:37:11.444774 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: Tue Oct 12 04:37:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 12 04:37:24.092890 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 04:37:24.093681 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: Tue Oct 12 04:37:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 12 04:38:33.374493 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 04:38:33.375090 dv-cinder-813067-1-iscsi devstack@n-api.service[108897]: Tue Oct 12 04:38:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 12 04:38:35.291116 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 04:38:35.291646 dv-cinder-813067-1-iscsi devstack@n-api.service[108898]: Tue Oct 12 04:38:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!